[ 544.666937] env[65263]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 544.666937] env[65263]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 545.648901] env[65353]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 545.648901] env[65353]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 547.198436] env[65353]: INFO neutron.common.config [-] Logging enabled! [ 547.198814] env[65353]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev39 [ 547.199021] env[65353]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65353) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 547.199328] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 547.199427] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 547.200327] env[65353]: WARNING oslo_policy.policy [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.201491] env[65353]: WARNING oslo_policy.policy [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.202157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] VMware NSXv3 Agent initialized successfully. [ 547.202513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Acquiring lock "singleton_lock" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.202662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Acquired lock "singleton_lock" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.202869] env[65353]: DEBUG oslo_concurrency.lockutils [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Releasing lock "singleton_lock" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.203168] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Full set of CONF: {{(pid=65353) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 547.203273] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ******************************************************************************** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 547.203370] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Configuration options gathered from: {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 547.203714] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 547.203880] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 547.203982] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ================================================================================ {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 547.204157] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] agent_down_time = 75 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204294] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] allow_automatic_dhcp_failover = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204425] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] allow_bulk = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204562] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] api_extensions_path = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204698] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] api_paste_config = api-paste.ini {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204835] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] auth_strategy = keystone {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.204936] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] backdoor_port = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205045] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] backdoor_socket = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205182] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] backlog = 4096 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205315] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205466] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] bind_host = 0.0.0.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205601] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] bind_port = 9696 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205731] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] client_socket_timeout = 900 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205864] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] config_dir = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.205968] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206112] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] config_source = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206282] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] control_exchange = neutron {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206396] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] core_plugin = ml2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206509] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] debug = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206643] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] default_availability_zones = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206844] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.206978] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dhcp_agent_notification = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207121] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dhcp_agents_per_network = 1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207249] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dhcp_lease_duration = 86400 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207385] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dhcp_load_type = networks {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207519] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dns_domain = openstacklocal {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207651] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207777] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_default_route_bfd = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.207905] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_default_route_ecmp = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208044] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_dvr = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208177] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_new_agents = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208307] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208437] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_signals = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208563] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] enable_traditional_dhcp = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208687] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] external_dns_driver = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208812] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] filter_validation = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.208952] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] global_physnet_mtu = 8950 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209109] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] graceful_shutdown_timeout = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209292] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] host = cpu-1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209440] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] host_dvr_for_dhcp = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209584] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] http_retries = 3 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209731] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] instance_format = [instance: %(uuid)s] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.209878] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210033] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ipam_driver = internal {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210181] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ipv6_pd_enabled = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210347] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] l3_ha = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210503] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210643] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] l3_ha_network_physical_name = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210780] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] l3_ha_network_type = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.210918] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_color = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211062] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_config_append = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211200] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211331] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_dir = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211460] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_file = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211559] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_options = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211693] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_rotate_interval = 1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211829] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_rotate_interval_type = days {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.211961] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] log_rotation_type = none {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212073] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212174] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212309] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212443] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212542] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212695] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_dns_nameservers = 5 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212831] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_header_line = 16384 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.212960] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_l3_agents_per_router = 3 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213099] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_logfile_count = 30 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213227] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_logfile_size_mb = 200 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213356] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] max_subnet_host_routes = 20 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213494] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] my_ip = 10.180.1.21 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213630] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] my_ipv6 = ::1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213759] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] network_auto_schedule = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.213881] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] network_link_prefix = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214016] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214154] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] notify_nova_on_port_data_changes = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214286] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] notify_nova_on_port_status_changes = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214421] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] pagination_max_limit = -1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214549] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] publish_errors = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214674] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rate_limit_burst = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214807] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rate_limit_except_level = CRITICAL {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.214936] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rate_limit_interval = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215072] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] retry_until_window = 30 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215198] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] router_distributed = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215326] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rpc_resources_processing_step = 20 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215453] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rpc_response_max_timeout = 600 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215582] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] rpc_response_timeout = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215705] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] send_events_interval = 2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215848] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] service_plugins = ['router'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.215984] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] setproctitle = on {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216119] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] shell_completion = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216251] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] state_path = /opt/stack/data/neutron {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216383] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] syslog_log_facility = LOG_USER {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216511] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] tcp_keepidle = 600 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216646] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] transport_url = **** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216771] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] use_journal = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.216897] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] use_json = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217036] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] use_ssl = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217165] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] use_stderr = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217298] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] use_syslog = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217423] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vlan_qinq = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217544] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vlan_transparent = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217669] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] watch_log_file = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217794] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] wsgi_default_pool_size = 100 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.217918] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] wsgi_keep_alive = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.218060] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.218205] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] wsgi_server_debug = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.218368] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_concurrency.disable_process_locking = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.218513] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.218657] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.218791] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.218927] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219075] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219209] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219357] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.connection_string = messaging:// {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219496] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.enabled = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219632] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.es_doc_type = notification {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219763] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.es_scroll_size = 10000 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.219898] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.es_scroll_time = 2m {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220038] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.filter_error_trace = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220179] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.hmac_keys = **** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220352] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.sentinel_service_name = mymaster {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220500] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.socket_timeout = 0.1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220633] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.trace_requests = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220762] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler.trace_sqlalchemy = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.220906] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler_jaeger.process_tags = {} {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.221047] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler_jaeger.service_name_prefix = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.221182] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] profiler_otlp.service_name_prefix = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.221337] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.enforce_new_defaults = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.221602] env[65353]: WARNING oslo_config.cfg [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 547.221746] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.enforce_scope = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.221888] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.policy_default_rule = default {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222045] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222189] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222327] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222466] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222597] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222723] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222851] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.222985] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223144] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223293] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] agent.extensions = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223431] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223569] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] service_providers.service_provider = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223709] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.default_quota = -1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223848] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.223980] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_floatingip = 50 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224123] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_network = 100 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224251] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_port = 500 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224377] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224505] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_router = 10 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224632] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_security_group = 10 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224762] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.224896] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.quota_subnet = 100 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225035] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] QUOTAS.track_quota_usage = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225183] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225316] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225447] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225580] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225717] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225848] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.225977] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226130] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226261] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226389] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226522] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226656] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226787] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.226915] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_dhcp_release.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227064] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227197] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227379] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227458] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227583] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227714] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227842] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_ovs_vsctl.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.227977] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.capabilities = [21] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228115] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228265] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228404] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228540] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228674] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228798] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_namespace.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.228933] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.capabilities = [12] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229075] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229206] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229336] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229470] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229603] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229731] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_conntrack.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229869] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.capabilities = [12, 21] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.229997] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.group = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230137] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.helper_command = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230273] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.log_daemon_traceback = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230433] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230571] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.thread_pool_size = 8 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230700] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] privsep_link.user = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230849] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.230995] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231146] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.continue_on_failed_promotions = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231290] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.dscp = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231440] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.dscp_inherit = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231579] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.force_mp_to_policy = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231711] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.locking_coordinator_url = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231844] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.log_agent_heartbeats = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.231979] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.logging_expire = 1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232135] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232274] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232417] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.polling_interval = 240 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232554] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232692] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232832] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.report_interval = 30.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.232972] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233122] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233261] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233400] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.sync_skew = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233536] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.synchronization_queue_size = 20 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233671] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT.use_helper_for_ns_read = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233812] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] SECURITYGROUP.enable_ipset = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.233952] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] SECURITYGROUP.enable_security_group = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234102] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234243] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234384] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] experimental.ipv6_pd_enabled = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234540] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.extension_drivers = ['port_security'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234674] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.external_network_type = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234820] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.234957] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.overlay_ip_version = 4 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235107] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.path_mtu = 8950 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235248] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.physical_network_mtus = {} {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235390] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235528] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235665] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ml2.type_drivers = ['vlan'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235805] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.235937] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236075] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236218] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236358] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236493] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236627] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236765] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.236901] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237100] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237244] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_login_password = **** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237388] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237523] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_login_user = admin {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237661] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237801] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.237934] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238075] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238235] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238389] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238529] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238664] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238798] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.238936] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239088] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239223] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239359] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239545] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239688] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239825] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.239957] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240107] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.auth_section = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240248] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.auth_type = password {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240413] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240548] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.certfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240683] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.collect_timing = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240824] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.endpoint_type = public {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.240954] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.insecure = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241093] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.keyfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241232] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.region_name = RegionOne {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241400] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.split_loggers = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241537] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] nova.timeout = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241677] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.auth_section = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241820] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.auth_type = password {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.241955] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242097] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.certfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242230] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.collect_timing = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242369] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.endpoint_type = public {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242500] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.insecure = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242625] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.keyfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242749] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.region_name = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.242877] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.split_loggers = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243008] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] placement.timeout = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243148] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.auth_section = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243277] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.auth_type = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243406] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.cafile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243538] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.certfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243659] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.collect_timing = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243787] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.connect_retries = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.243909] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.connect_retry_delay = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244072] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.enable_notifications = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244174] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.endpoint_override = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244304] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.insecure = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244431] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.interface = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244557] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.keyfile = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244685] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.max_version = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244810] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.min_version = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.244938] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.region_name = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245067] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.retriable_status_codes = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245195] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.service_name = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245320] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.service_type = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245506] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.split_loggers = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245650] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.status_code_retries = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245780] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.status_code_retry_delay = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.245908] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.timeout = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246046] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.valid_interfaces = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246176] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ironic.version = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246311] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] cli_script.dry_run = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246453] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246584] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246716] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246846] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.246977] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247117] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247259] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247423] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247560] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247701] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247830] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.247973] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248120] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248260] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248393] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248531] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248660] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248793] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.248932] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249076] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249210] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249339] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249470] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249602] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249735] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249867] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.249997] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250146] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250282] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250443] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250581] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250724] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250861] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.250994] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251147] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251299] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251453] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251594] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_notifications.driver = [] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251728] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_notifications.retry = -1 {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.251935] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.252081] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.252189] env[65353]: DEBUG oslo_service.backend._eventlet.service [None req-9946810c-cc73-4f02-aa68-2c46c5b51491 None None] ******************************************************************************** {{(pid=65353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 547.253364] env[65353]: DEBUG neutron.agent.securitygroups_rpc [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Init firewall settings (driver=nsxv3) {{(pid=65353) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 547.254697] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65353) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 547.254939] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] RPC agent_id: nsxm-l-01a.corp.local [ 547.257201] env[65353]: DEBUG dogpile.cache.region [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 547.257307] env[65353]: DEBUG dogpile.lock [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 547.257404] env[65353]: DEBUG dogpile.lock [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 547.257490] env[65353]: DEBUG dogpile.lock [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 547.257577] env[65353]: DEBUG dogpile.cache.region [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 547.257659] env[65353]: DEBUG dogpile.lock [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 547.257775] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 547.278853] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Session token - acquiring [ 547.280380] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.280564] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.280683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.281094] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.291857] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.576569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 547.598310] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 547.601269] env[65353]: DEBUG dogpile.cache.region [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 547.601269] env[65353]: DEBUG dogpile.lock [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 547.601269] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Activating Policy API Provider. [ 547.601269] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Looking for the default Infrastructure Rules. [ 547.664020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Looking for the Default Layer3 Logged Drop Section. [ 547.680505] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 547.680967] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.681146] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.681243] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.681600] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.681922] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.196748] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.699167] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.201881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Inventory metadata is going to be refreshed. [ 549.202150] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.963858] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.964361] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.964361] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.964552] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.976619] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.977495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.978226] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.996470] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.996746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.996746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.997022] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.997146] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.997284] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.997393] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.997503] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 550.017264] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.017486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.017532] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.017857] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.018064] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.018209] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.043268] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.043531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.043531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.043826] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.043963] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.044118] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.066754] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.066966] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.067035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.067311] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.067448] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.067591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 550.067690] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.067788] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 550.090241] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.090522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.090673] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.091022] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.091156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.091335] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 550.091561] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.091802] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 550.114900] env[65353]: DEBUG networking_nsxv3.common.locking [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.115250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.115250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.115501] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.115640] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.115796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 550.115919] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.116040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Inventory metadata have been refreshed. [ 550.116126] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Dryrun:True. Metadata refresh completed. [ 550.116220] env[65353]: DEBUG oslo_concurrency.lockutils [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.117812] env[65353]: INFO neutron.agent.agent_extensions_manager [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Loaded agent extensions: [] [ 550.118553] env[65353]: DEBUG neutron_lib.callbacks.manager [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65353) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 550.197989] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent RPC Daemon Started! [ 550.198216] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:0 started [ 550.198216] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent out of sync with plugin! [ 555.119820] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.120325] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.120636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.120802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.120870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.121176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.121354] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.624025] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.126339] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.629064] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 556.629225] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 557.367339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.367736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.367736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.367736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.379667] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 557.380559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.381199] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 557.398218] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.398425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.398425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.398634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.398721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.398827] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 557.398898] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.398966] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 557.419079] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.419288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.419288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.419476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.419609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.419713] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 557.440780] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.440960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.440960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.441176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.441279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.441440] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 557.459132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.459301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.459358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.459514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.459615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.459726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 557.459797] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.459866] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 557.477637] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.477848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.477848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.478045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.478135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.478254] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 557.478320] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.478389] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 557.498615] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.499184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.499184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.499184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.499184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.499330] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 557.499330] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.499330] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 557.499413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 557.499511] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 557.499511] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 557.499606] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 557.499839] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 557.499901] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 557.499968] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 557.522937] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.523191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.523191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.523368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.523456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.523560] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 557.543075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.543252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.543252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.543459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.543593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.556993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.122991] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.123413] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.124124] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.124475] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.255061] env[65353]: INFO networking_nsxv3.common.synchronization [None req-9ee62b83-eb6b-4b48-a323-3651c9a2fcb3 demo admin] Enqueued Resource ID: 597a4acc-f623-4a36-a4e1-a303c55be81d with Priority: HIGHEST for action security_group_rules [ 565.255591] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597a4acc-f623-4a36-a4e1-a303c55be81d with Priority: HIGHEST for action security_group_rules [ 565.255905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597a4acc-f623-4a36-a4e1-a303c55be81d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.256035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597a4acc-f623-4a36-a4e1-a303c55be81d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.256104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597a4acc-f623-4a36-a4e1-a303c55be81d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.256344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597a4acc-f623-4a36-a4e1-a303c55be81d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.256428] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597a4acc-f623-4a36-a4e1-a303c55be81d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.778261] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.778578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.778578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.778744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.778805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.778885] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597a4acc-f623-4a36-a4e1-a303c55be81d already deleted. [ 565.778969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597a4acc-f623-4a36-a4e1-a303c55be81d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.256407] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.256407] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.257712] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.257712] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.258214] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.258577] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 585.260034] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.260034] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 590.259888] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.260251] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.261460] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.261460] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 596.623928] env[65353]: INFO networking_nsxv3.common.synchronization [None req-fa8c590f-8d2b-43fb-bd91-674d2ee200af None None] Enqueued Resource ID: bf48dc3e-5cb6-4e17-a4e2-c3355af74671 with Priority: HIGHEST for action port [ 596.623928] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf48dc3e-5cb6-4e17-a4e2-c3355af74671 with Priority: HIGHEST for action port [ 596.624846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf48dc3e-5cb6-4e17-a4e2-c3355af74671 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.624846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf48dc3e-5cb6-4e17-a4e2-c3355af74671" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.624846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf48dc3e-5cb6-4e17-a4e2-c3355af74671" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.625134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf48dc3e-5cb6-4e17-a4e2-c3355af74671" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.625134] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf48dc3e-5cb6-4e17-a4e2-c3355af74671',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.668792] env[65353]: INFO networking_nsxv3.common.synchronization [None req-492b7dd3-106c-4508-a164-59fefb6498b0 None None] Enqueued Resource ID: 38f3d018-8c76-4c48-9d5c-bad3cd4da921 with Priority: HIGHEST for action port [ 596.671734] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f3d018-8c76-4c48-9d5c-bad3cd4da921 with Priority: HIGHEST for action port [ 596.671734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-38f3d018-8c76-4c48-9d5c-bad3cd4da921 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.671734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38f3d018-8c76-4c48-9d5c-bad3cd4da921" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.671734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38f3d018-8c76-4c48-9d5c-bad3cd4da921" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.671734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38f3d018-8c76-4c48-9d5c-bad3cd4da921" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.671734] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38f3d018-8c76-4c48-9d5c-bad3cd4da921',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.130740] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf48dc3e-5cb6-4e17-a4e2-c3355af74671 [ 597.130740] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.131101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.131101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.131213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.131294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.131392] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf48dc3e-5cb6-4e17-a4e2-c3355af74671 already deleted. [ 597.131481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf48dc3e-5cb6-4e17-a4e2-c3355af74671" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.176240] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38f3d018-8c76-4c48-9d5c-bad3cd4da921 [ 597.176240] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.176240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.176240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.176240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.176240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.176240] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38f3d018-8c76-4c48-9d5c-bad3cd4da921 already deleted. [ 597.176240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38f3d018-8c76-4c48-9d5c-bad3cd4da921" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.540143] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d551f879-aafc-4961-b290-1fd1219d1e32 None None] Enqueued Resource ID: 4f36d9fd-49dd-409c-abca-bd99cfebc749 with Priority: HIGHEST for action port [ 597.540389] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f36d9fd-49dd-409c-abca-bd99cfebc749 with Priority: HIGHEST for action port [ 597.540999] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f36d9fd-49dd-409c-abca-bd99cfebc749 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.541136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f36d9fd-49dd-409c-abca-bd99cfebc749" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.541203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f36d9fd-49dd-409c-abca-bd99cfebc749" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.541439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f36d9fd-49dd-409c-abca-bd99cfebc749" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.541518] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f36d9fd-49dd-409c-abca-bd99cfebc749',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.731192] env[65353]: INFO networking_nsxv3.common.synchronization [None req-785db44b-b428-4b92-b7ed-46ee6d411c88 None None] Enqueued Resource ID: 2d39eccc-1dac-4874-b783-d731922a819b with Priority: HIGHEST for action port [ 597.731968] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d39eccc-1dac-4874-b783-d731922a819b with Priority: HIGHEST for action port [ 597.732589] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d39eccc-1dac-4874-b783-d731922a819b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.732589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d39eccc-1dac-4874-b783-d731922a819b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.732767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d39eccc-1dac-4874-b783-d731922a819b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.732858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d39eccc-1dac-4874-b783-d731922a819b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.733115] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d39eccc-1dac-4874-b783-d731922a819b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.045764] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f36d9fd-49dd-409c-abca-bd99cfebc749 [ 598.045764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.045764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.045764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.045764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.045764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.045764] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f36d9fd-49dd-409c-abca-bd99cfebc749 already deleted. [ 598.045764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f36d9fd-49dd-409c-abca-bd99cfebc749" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236679] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d39eccc-1dac-4874-b783-d731922a819b [ 598.236912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.237051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.237118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.237332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.237407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.237503] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d39eccc-1dac-4874-b783-d731922a819b already deleted. [ 598.237582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d39eccc-1dac-4874-b783-d731922a819b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.578164] env[65353]: INFO networking_nsxv3.common.synchronization [None req-8ec8f596-85f0-4029-8a74-86755cc2dfef None None] Enqueued Resource ID: 3d388631-2287-4e6f-8240-0f43297464b8 with Priority: HIGHEST for action port [ 599.578164] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d388631-2287-4e6f-8240-0f43297464b8 with Priority: HIGHEST for action port [ 599.579630] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d388631-2287-4e6f-8240-0f43297464b8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.581763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d388631-2287-4e6f-8240-0f43297464b8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.581763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d388631-2287-4e6f-8240-0f43297464b8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.581763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d388631-2287-4e6f-8240-0f43297464b8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.581763] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d388631-2287-4e6f-8240-0f43297464b8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.084690] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d388631-2287-4e6f-8240-0f43297464b8 [ 600.084929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.085087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.085161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.085372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.085461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.085657] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d388631-2287-4e6f-8240-0f43297464b8 already deleted. [ 600.085657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d388631-2287-4e6f-8240-0f43297464b8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.281548] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2b207ba6-c946-410e-9eb1-5e7cf9b3bdcf None None] Enqueued Resource ID: 6d1c89ed-7a87-40cb-992b-7a4a3b8de46a with Priority: HIGHEST for action port [ 600.282843] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d1c89ed-7a87-40cb-992b-7a4a3b8de46a with Priority: HIGHEST for action port [ 600.283185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d1c89ed-7a87-40cb-992b-7a4a3b8de46a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.283341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d1c89ed-7a87-40cb-992b-7a4a3b8de46a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.283376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d1c89ed-7a87-40cb-992b-7a4a3b8de46a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.283610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d1c89ed-7a87-40cb-992b-7a4a3b8de46a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.283692] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1c89ed-7a87-40cb-992b-7a4a3b8de46a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.785920] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d1c89ed-7a87-40cb-992b-7a4a3b8de46a [ 600.787025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.787507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.787713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.788479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.789222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.789772] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d1c89ed-7a87-40cb-992b-7a4a3b8de46a already deleted. [ 600.790067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d1c89ed-7a87-40cb-992b-7a4a3b8de46a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.875299] env[65353]: INFO networking_nsxv3.common.synchronization [None req-359845d6-2c4d-4858-b586-06acdea536ee None None] Enqueued Resource ID: 8b461176-0413-4caf-a2e9-8bf23348521a with Priority: HIGHEST for action port [ 600.876947] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b461176-0413-4caf-a2e9-8bf23348521a with Priority: HIGHEST for action port [ 600.877410] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b461176-0413-4caf-a2e9-8bf23348521a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.877539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b461176-0413-4caf-a2e9-8bf23348521a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.877615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b461176-0413-4caf-a2e9-8bf23348521a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.877857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b461176-0413-4caf-a2e9-8bf23348521a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.877941] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b461176-0413-4caf-a2e9-8bf23348521a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.382197] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b461176-0413-4caf-a2e9-8bf23348521a [ 601.382197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.382197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.382197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.382197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.382197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.382197] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b461176-0413-4caf-a2e9-8bf23348521a already deleted. [ 601.382515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b461176-0413-4caf-a2e9-8bf23348521a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.046496] env[65353]: INFO networking_nsxv3.common.synchronization [None req-23d388f6-6567-434b-ba40-54c610fe8329 None None] Enqueued Resource ID: c83fcb21-53a5-486b-b849-d2174d412bbe with Priority: HIGHEST for action port [ 602.047107] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83fcb21-53a5-486b-b849-d2174d412bbe with Priority: HIGHEST for action port [ 602.047689] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c83fcb21-53a5-486b-b849-d2174d412bbe taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.048274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c83fcb21-53a5-486b-b849-d2174d412bbe" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.048351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c83fcb21-53a5-486b-b849-d2174d412bbe" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.048600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c83fcb21-53a5-486b-b849-d2174d412bbe" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.048676] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c83fcb21-53a5-486b-b849-d2174d412bbe',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.552486] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c83fcb21-53a5-486b-b849-d2174d412bbe [ 602.552486] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.552723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.552723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.552913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.553010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.553112] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c83fcb21-53a5-486b-b849-d2174d412bbe already deleted. [ 602.553195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c83fcb21-53a5-486b-b849-d2174d412bbe" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.822660] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a26953ce-43ae-4bdb-b063-1c37cc7ea220 None None] Enqueued Resource ID: 3fec2703-4f61-426b-a524-05a47aa2fce9 with Priority: HIGHEST for action port [ 602.822931] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fec2703-4f61-426b-a524-05a47aa2fce9 with Priority: HIGHEST for action port [ 602.823513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fec2703-4f61-426b-a524-05a47aa2fce9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.823649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fec2703-4f61-426b-a524-05a47aa2fce9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fec2703-4f61-426b-a524-05a47aa2fce9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.823934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fec2703-4f61-426b-a524-05a47aa2fce9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.826052] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fec2703-4f61-426b-a524-05a47aa2fce9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.070703] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d72dccf4-99a7-4d10-9570-3e5fb86395b9 None None] Enqueued Resource ID: 5925aa6f-1a2a-4351-9eff-bb1cf8c734d8 with Priority: HIGHEST for action port [ 603.070703] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925aa6f-1a2a-4351-9eff-bb1cf8c734d8 with Priority: HIGHEST for action port [ 603.070703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5925aa6f-1a2a-4351-9eff-bb1cf8c734d8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.070703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5925aa6f-1a2a-4351-9eff-bb1cf8c734d8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.070703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5925aa6f-1a2a-4351-9eff-bb1cf8c734d8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.071163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5925aa6f-1a2a-4351-9eff-bb1cf8c734d8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.071419] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5925aa6f-1a2a-4351-9eff-bb1cf8c734d8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.328678] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fec2703-4f61-426b-a524-05a47aa2fce9 [ 603.328843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.329176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.329176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.329360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.329462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.329526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fec2703-4f61-426b-a524-05a47aa2fce9 already deleted. [ 603.329619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fec2703-4f61-426b-a524-05a47aa2fce9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.574104] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5925aa6f-1a2a-4351-9eff-bb1cf8c734d8 [ 603.574370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.574541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.574612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.574853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.574935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.575049] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5925aa6f-1a2a-4351-9eff-bb1cf8c734d8 already deleted. [ 603.576438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5925aa6f-1a2a-4351-9eff-bb1cf8c734d8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.531340] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f21af7e6-14cc-478f-bd96-2046eb35c714 None None] Enqueued Resource ID: a67bf8af-43a9-42eb-b440-9b0f08666d21 with Priority: HIGHEST for action port [ 604.532389] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67bf8af-43a9-42eb-b440-9b0f08666d21 with Priority: HIGHEST for action port [ 604.532645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67bf8af-43a9-42eb-b440-9b0f08666d21 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.532868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67bf8af-43a9-42eb-b440-9b0f08666d21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.533024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67bf8af-43a9-42eb-b440-9b0f08666d21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.533454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67bf8af-43a9-42eb-b440-9b0f08666d21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.533640] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67bf8af-43a9-42eb-b440-9b0f08666d21',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.958723] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e6a0b1be-ae90-4672-a8ae-b11ad41bf468 None None] Enqueued Resource ID: 07546d28-cde7-43c4-bff4-cdb3d09ea5e9 with Priority: HIGHEST for action port [ 604.958977] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07546d28-cde7-43c4-bff4-cdb3d09ea5e9 with Priority: HIGHEST for action port [ 604.959580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-07546d28-cde7-43c4-bff4-cdb3d09ea5e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.959709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07546d28-cde7-43c4-bff4-cdb3d09ea5e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.959777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07546d28-cde7-43c4-bff4-cdb3d09ea5e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.960390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07546d28-cde7-43c4-bff4-cdb3d09ea5e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.960526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07546d28-cde7-43c4-bff4-cdb3d09ea5e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.036272] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a67bf8af-43a9-42eb-b440-9b0f08666d21 [ 605.036272] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.036272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.036503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.037322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.037322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.037322] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a67bf8af-43a9-42eb-b440-9b0f08666d21 already deleted. [ 605.037322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67bf8af-43a9-42eb-b440-9b0f08666d21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.462469] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07546d28-cde7-43c4-bff4-cdb3d09ea5e9 [ 605.462699] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.463060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.463060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.464086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.464086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.464086] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07546d28-cde7-43c4-bff4-cdb3d09ea5e9 already deleted. [ 605.464086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07546d28-cde7-43c4-bff4-cdb3d09ea5e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.763990] env[65353]: INFO networking_nsxv3.common.synchronization [None req-31b69750-1a42-45de-82d9-65389b4703bf None None] Enqueued Resource ID: 7f450f5a-3556-416d-ae16-4f8f1b915c58 with Priority: HIGHEST for action port [ 606.764294] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f450f5a-3556-416d-ae16-4f8f1b915c58 with Priority: HIGHEST for action port [ 606.764631] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f450f5a-3556-416d-ae16-4f8f1b915c58 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.764764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f450f5a-3556-416d-ae16-4f8f1b915c58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.764833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f450f5a-3556-416d-ae16-4f8f1b915c58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.765674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f450f5a-3556-416d-ae16-4f8f1b915c58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.765674] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f450f5a-3556-416d-ae16-4f8f1b915c58',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.842367] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4d3c8667-89e4-4402-bd98-29bd90204cdc None None] Enqueued Resource ID: ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c with Priority: HIGHEST for action port [ 606.842728] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c with Priority: HIGHEST for action port [ 606.842837] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.842962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.843440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.845356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.845449] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.268535] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f450f5a-3556-416d-ae16-4f8f1b915c58 [ 607.268782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.268915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.268992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.269242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.269325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.269421] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f450f5a-3556-416d-ae16-4f8f1b915c58 already deleted. [ 607.269495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f450f5a-3556-416d-ae16-4f8f1b915c58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.348724] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c [ 607.348854] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.350026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.350026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.350026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.350026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.350026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c already deleted. [ 607.350026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea1fd4e5-e847-4ff5-b2d6-79abf1fab69c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.354266] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1a95567c-2d4d-4c38-b32f-f87bd45b2fa7 None None] Enqueued Resource ID: 6bcfad8b-827a-4d77-999f-c2cf0eca00da with Priority: HIGHEST for action port [ 608.354861] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcfad8b-827a-4d77-999f-c2cf0eca00da with Priority: HIGHEST for action port [ 608.356951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bcfad8b-827a-4d77-999f-c2cf0eca00da taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.356951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bcfad8b-827a-4d77-999f-c2cf0eca00da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.356951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bcfad8b-827a-4d77-999f-c2cf0eca00da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.356951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bcfad8b-827a-4d77-999f-c2cf0eca00da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.356951] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcfad8b-827a-4d77-999f-c2cf0eca00da',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.820471] env[65353]: INFO networking_nsxv3.common.synchronization [None req-82d46537-4bec-44db-84b3-8b7ef0da798f None None] Enqueued Resource ID: d0aeb040-bf21-4d6d-a240-5994eb744039 with Priority: HIGHEST for action port [ 608.820745] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0aeb040-bf21-4d6d-a240-5994eb744039 with Priority: HIGHEST for action port [ 608.821588] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0aeb040-bf21-4d6d-a240-5994eb744039 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.821588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0aeb040-bf21-4d6d-a240-5994eb744039" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.821588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0aeb040-bf21-4d6d-a240-5994eb744039" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.821901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0aeb040-bf21-4d6d-a240-5994eb744039" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.823950] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0aeb040-bf21-4d6d-a240-5994eb744039',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.860457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bcfad8b-827a-4d77-999f-c2cf0eca00da [ 608.860769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.860948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.861203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.861398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.861534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.861668] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bcfad8b-827a-4d77-999f-c2cf0eca00da already deleted. [ 608.861790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bcfad8b-827a-4d77-999f-c2cf0eca00da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.056956] env[65353]: INFO networking_nsxv3.common.synchronization [req-3abd40cb-fee0-49bf-8584-7df5077e3b12 req-c02dac99-dbee-47f6-8199-fb7a0ab6f276 tempest-DeleteServersAdminTestJSON-257666599 tempest-DeleteServersAdminTestJSON-257666599-project-member] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 609.056956] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 609.056956] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.056956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.056956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.057242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.057578] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.057735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.057735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.057941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.058045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.058152] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.326795] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0aeb040-bf21-4d6d-a240-5994eb744039 [ 609.326795] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.326795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.326795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.328282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.328514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.328582] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0aeb040-bf21-4d6d-a240-5994eb744039 already deleted. [ 609.328646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0aeb040-bf21-4d6d-a240-5994eb744039" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.564386] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.564778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.564778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.564925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.565034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.565263] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.565357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.565424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.565601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.565864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.565864] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 already deleted. [ 609.565957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.900910] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.904488] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.904488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.904488] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.904488] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.905125] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.906962] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.906962] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.906962] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.906962] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.929755] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.929918] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.930090] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.930805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.930805] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.930805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.931197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.931251] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.931393] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0060aeaf-c6b4-4fd7-92d2-2f800a64a643',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.437039] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.437039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.437039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.437039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.437548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.437548] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 not found, creating... [ 610.437637] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.437787] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.437940] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.438199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.438386] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.439858] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.440071] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.440234] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.440463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.440642] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.440745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 is going to be created. [ 610.466987] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.467281] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.467281] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.467462] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.467662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.467888] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.037602] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e5dc96da-6513-4804-8e9d-b33886f957b8 None None] Enqueued Resource ID: 242eeb11-2bda-4abb-afa4-f3d625d2261f with Priority: HIGHEST for action port [ 611.039952] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242eeb11-2bda-4abb-afa4-f3d625d2261f with Priority: HIGHEST for action port [ 611.040938] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-242eeb11-2bda-4abb-afa4-f3d625d2261f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.041220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-242eeb11-2bda-4abb-afa4-f3d625d2261f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.041300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-242eeb11-2bda-4abb-afa4-f3d625d2261f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.041555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-242eeb11-2bda-4abb-afa4-f3d625d2261f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.041708] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('242eeb11-2bda-4abb-afa4-f3d625d2261f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.250620] env[65353]: INFO networking_nsxv3.common.synchronization [req-3abd40cb-fee0-49bf-8584-7df5077e3b12 req-3cd4f5a7-2bdf-4fce-bd26-5e6f6c9a306b service nova] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_rules [ 611.250801] env[65353]: INFO networking_nsxv3.common.synchronization [req-3abd40cb-fee0-49bf-8584-7df5077e3b12 req-3cd4f5a7-2bdf-4fce-bd26-5e6f6c9a306b service nova] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 611.250931] env[65353]: INFO networking_nsxv3.common.synchronization [req-3abd40cb-fee0-49bf-8584-7df5077e3b12 req-3cd4f5a7-2bdf-4fce-bd26-5e6f6c9a306b service nova] Enqueued Resource ID: 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 with Priority: HIGHEST for action port [ 611.251459] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_rules [ 611.251734] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 611.251734] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 with Priority: HIGHEST for action port [ 611.251963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.252121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.255736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.255992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.256090] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.256973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.257110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.257181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.257344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.257522] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.257641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.257705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.257847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.257929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.258642] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.259532] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.259532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.259693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.259784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.259864] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0060aeaf-c6b4-4fd7-92d2-2f800a64a643',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.544803] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 242eeb11-2bda-4abb-afa4-f3d625d2261f [ 611.545056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.545234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.545303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.545522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.545605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.545693] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:242eeb11-2bda-4abb-afa4-f3d625d2261f already deleted. [ 611.545771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-242eeb11-2bda-4abb-afa4-f3d625d2261f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.762346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.762479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.769504] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 with status ACTIVE [ 611.769727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.769865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.769931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.770246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.770246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.770409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.770515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.770567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.770714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.770792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.770965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.771133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.771202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.771310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.771386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.771647] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0060aeaf-c6b4-4fd7-92d2-2f800a64a643 is going to be updated. [ 611.772601] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.797102] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.797102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.797102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.797102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.797102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.797102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0060aeaf-c6b4-4fd7-92d2-2f800a64a643" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.136695] env[65353]: INFO networking_nsxv3.common.synchronization [None req-9172d006-3fd2-43ad-8849-ef8bff00c764 tempest-VolumesAssistedSnapshotsTest-350081951 tempest-VolumesAssistedSnapshotsTest-350081951-project-member] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 612.137462] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 612.137909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.138119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.138229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.138490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.138590] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.278636] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.332632] env[65353]: INFO networking_nsxv3.common.synchronization [None req-8c6386ed-d98a-4419-88d3-69510b68481d tempest-VolumesAssistedSnapshotsTest-350081951 tempest-VolumesAssistedSnapshotsTest-350081951-project-member] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 612.333274] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 612.334276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.334378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.649294] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e000ce03-3c9c-4310-a160-e635eecc5164 None None] Enqueued Resource ID: c03fb40d-4702-4933-84dd-ffe7132f35a2 with Priority: HIGHEST for action port [ 612.649294] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c03fb40d-4702-4933-84dd-ffe7132f35a2 with Priority: HIGHEST for action port [ 612.649294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c03fb40d-4702-4933-84dd-ffe7132f35a2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.649294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c03fb40d-4702-4933-84dd-ffe7132f35a2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.649294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c03fb40d-4702-4933-84dd-ffe7132f35a2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.649294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c03fb40d-4702-4933-84dd-ffe7132f35a2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.649294] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c03fb40d-4702-4933-84dd-ffe7132f35a2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.663198] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.663750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.666019] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 already deleted. [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.666019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.666019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.784511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.784511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.784511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.784511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.784511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.784511] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be created. [ 612.809595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.809595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.809595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.809815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.810106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.821781] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: UNINITIALIZED for 2s [ 613.154139] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c03fb40d-4702-4933-84dd-ffe7132f35a2 [ 613.154139] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.154139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.154139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.154139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.154139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.154139] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c03fb40d-4702-4933-84dd-ffe7132f35a2 already deleted. [ 613.154139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c03fb40d-4702-4933-84dd-ffe7132f35a2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.187746] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.187746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.187746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.187746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.187969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.188031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 already deleted. [ 613.188436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.832931] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 614.833500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.833500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.834292] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.834292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.835141] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.216815] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c835b86f-1782-48b9-961a-145f72a5b8ca None None] Enqueued Resource ID: 68ea4b3f-e06c-46d7-8efe-067b7dff0c8b with Priority: HIGHEST for action port [ 615.217456] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ea4b3f-e06c-46d7-8efe-067b7dff0c8b with Priority: HIGHEST for action port [ 615.217658] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-68ea4b3f-e06c-46d7-8efe-067b7dff0c8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.217787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68ea4b3f-e06c-46d7-8efe-067b7dff0c8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.218042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68ea4b3f-e06c-46d7-8efe-067b7dff0c8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.218633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68ea4b3f-e06c-46d7-8efe-067b7dff0c8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.218723] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68ea4b3f-e06c-46d7-8efe-067b7dff0c8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.337480] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.337663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.337735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.338363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.338363] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.338363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.338363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.338544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.338544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.338613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.338699] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.338789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.338846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.338988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.339150] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.339239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.339297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.339430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.339503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.339581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.339668] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.724160] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68ea4b3f-e06c-46d7-8efe-067b7dff0c8b [ 615.724160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.724160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.724160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.724160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.724160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.724160] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68ea4b3f-e06c-46d7-8efe-067b7dff0c8b already deleted. [ 615.724506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68ea4b3f-e06c-46d7-8efe-067b7dff0c8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.846442] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462: rpc.has_security_group_logging(os_id): False [ 615.866297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.866456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.866507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.867163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.867163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.867163] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.867317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.867317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.867597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.867741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.867911] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.868213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.868213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.868921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.868921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.869175] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.870040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.870040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.870040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.870040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.870040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be created. [ 615.972779] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.972779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.972779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.972779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.972779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.994127] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 616.642390] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-e663b8bd-94c3-49bb-8eed-ebfad5dcf591 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 616.642839] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 616.644270] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.644395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.644469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.644714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.645081] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.645081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.645081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.645232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.645436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.645436] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.043120] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.043495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.043495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.043895] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.044325] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.044725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.044823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.045045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.045438] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.049023] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.049023] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.049023] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.049023] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.049023] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.049023] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.049023] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.067843] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.068023] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.068184] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.068366] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.068673] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.068832] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.068943] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.069472] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.069669] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d3b894-030a-4b95-9ef0-b8a55ed1515d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.148062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.148252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.148361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.148688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.148759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.149080] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.149080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.149206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.149341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.149341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.149463] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 already deleted. [ 617.149512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.572367] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.574661] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port d5d3b894-030a-4b95-9ef0-b8a55ed1515d not found, creating... [ 617.574661] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.574661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.575749] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.575749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.575749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.575749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.575749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.575749] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: d5d3b894-030a-4b95-9ef0-b8a55ed1515d is going to be created. [ 617.598247] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.598507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.598669] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.598959] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.599327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.599601] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.006978] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 618.007258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.118960] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f7c5346d-312a-45fc-9cc3-9c46b5f796fe None None] Enqueued Resource ID: c1b46226-a712-41bc-8371-3eea42e2c127 with Priority: HIGHEST for action port [ 618.121348] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b46226-a712-41bc-8371-3eea42e2c127 with Priority: HIGHEST for action port [ 618.121348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1b46226-a712-41bc-8371-3eea42e2c127 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.121348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1b46226-a712-41bc-8371-3eea42e2c127" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.121348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1b46226-a712-41bc-8371-3eea42e2c127" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.121348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1b46226-a712-41bc-8371-3eea42e2c127" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.121685] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b46226-a712-41bc-8371-3eea42e2c127',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.304915] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-73b6db8c-9437-41a4-aa0b-796fb541514d service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 618.305443] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-73b6db8c-9437-41a4-aa0b-796fb541514d service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 618.305443] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-73b6db8c-9437-41a4-aa0b-796fb541514d service nova] Enqueued Resource ID: d5d3b894-030a-4b95-9ef0-b8a55ed1515d with Priority: HIGHEST for action port [ 618.307061] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 618.307061] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 618.307061] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5d3b894-030a-4b95-9ef0-b8a55ed1515d with Priority: HIGHEST for action port [ 618.307061] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.307061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.307061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.307061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.307061] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.307837] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.308907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.308907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.309214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.309401] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.309531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.309599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.310894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.310894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.310894] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.311475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.311475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.311670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.311730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.311816] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d3b894-030a-4b95-9ef0-b8a55ed1515d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.624032] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1b46226-a712-41bc-8371-3eea42e2c127 [ 618.624392] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.625296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.625296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.625296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.625296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.625296] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1b46226-a712-41bc-8371-3eea42e2c127 already deleted. [ 618.625296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1b46226-a712-41bc-8371-3eea42e2c127" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.807903] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a13bc009-3fa9-4ad1-b76d-74b7599b3307 None None] Enqueued Resource ID: 480a12d5-7c56-4c74-8d04-5af7b4ed30e5 with Priority: HIGHEST for action port [ 618.807903] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a12d5-7c56-4c74-8d04-5af7b4ed30e5 with Priority: HIGHEST for action port [ 618.807903] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-480a12d5-7c56-4c74-8d04-5af7b4ed30e5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.807903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-480a12d5-7c56-4c74-8d04-5af7b4ed30e5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.807903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-480a12d5-7c56-4c74-8d04-5af7b4ed30e5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.807903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-480a12d5-7c56-4c74-8d04-5af7b4ed30e5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.807903] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('480a12d5-7c56-4c74-8d04-5af7b4ed30e5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.812651] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.818021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5d3b894-030a-4b95-9ef0-b8a55ed1515d with status ACTIVE [ 618.818021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.818021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.818021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.818021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.818021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5d3b894-030a-4b95-9ef0-b8a55ed1515d is going to be updated. [ 618.818767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.818767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.839951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.839951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.839951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.839951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.839951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.839951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5d3b894-030a-4b95-9ef0-b8a55ed1515d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.895369] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-86b2415b-f758-4417-9673-ad4e17b582c8 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 618.895667] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 618.895981] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.896401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.310805] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 480a12d5-7c56-4c74-8d04-5af7b4ed30e5 [ 619.311165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.311316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.311387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.311605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.311696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.311791] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:480a12d5-7c56-4c74-8d04-5af7b4ed30e5 already deleted. [ 619.311871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-480a12d5-7c56-4c74-8d04-5af7b4ed30e5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.314303] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.422134] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.422370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.422507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.422694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.422938] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.423100] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.423208] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.425033] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.425033] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425033] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.425033] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.425033] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.425033] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.425033] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.425033] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.425033] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.444267] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.444267] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.444267] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.444267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.445094] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-3c33b7aa-f311-4557-a5d9-b373ffed03e2 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.445319] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.445493] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.446530] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.446530] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c33b7aa-f311-4557-a5d9-b373ffed03e2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.819641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.819789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.819853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.820080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.820173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.820274] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be created. [ 619.854732] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.854932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.854932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.855287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.855470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.865821] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: UNINITIALIZED for 2s [ 619.948774] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.949144] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.949699] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.949786] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.950061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.950310] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 3c33b7aa-f311-4557-a5d9-b373ffed03e2 not found, creating... [ 619.950710] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.951081] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.951164] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.952170] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.952170] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.952170] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.952373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.952515] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.952834] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.953051] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.953250] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 3c33b7aa-f311-4557-a5d9-b373ffed03e2 is going to be created. [ 619.982644] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.982867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.982997] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.983309] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.983576] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.983763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.680852] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0d76b8fb-4a0a-4ccc-8910-9cdcecd9d9e4 None None] Enqueued Resource ID: 8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f with Priority: HIGHEST for action port [ 620.681249] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f with Priority: HIGHEST for action port [ 620.681760] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.681923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.681981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.682282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.682368] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.712077] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-34f86362-576c-42fe-bd45-f36ffbe88671 service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 620.712247] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-34f86362-576c-42fe-bd45-f36ffbe88671 service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 620.712536] env[65353]: INFO networking_nsxv3.common.synchronization [req-52dfa440-9152-422e-9ece-4a58ac5a65dd req-34f86362-576c-42fe-bd45-f36ffbe88671 service nova] Enqueued Resource ID: 3c33b7aa-f311-4557-a5d9-b373ffed03e2 with Priority: HIGHEST for action port [ 620.713207] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 620.713474] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 620.713643] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c33b7aa-f311-4557-a5d9-b373ffed03e2 with Priority: HIGHEST for action port [ 620.714044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.714205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.714481] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.714549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.714759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c33b7aa-f311-4557-a5d9-b373ffed03e2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.715571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.715571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.715571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.715571] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c33b7aa-f311-4557-a5d9-b373ffed03e2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.818756] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e0f2cb7b-0f14-470e-9a24-faf800caca2a None None] Enqueued Resource ID: 7ba4757a-7a28-45e2-851b-9eef7d051878 with Priority: HIGHEST for action port [ 620.822128] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba4757a-7a28-45e2-851b-9eef7d051878 with Priority: HIGHEST for action port [ 620.822128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ba4757a-7a28-45e2-851b-9eef7d051878 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.822128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ba4757a-7a28-45e2-851b-9eef7d051878" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.822128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ba4757a-7a28-45e2-851b-9eef7d051878" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.822128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ba4757a-7a28-45e2-851b-9eef7d051878" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.822128] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ba4757a-7a28-45e2-851b-9eef7d051878',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.185179] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f [ 621.185428] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.185566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.185634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.185851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.185937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.186045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f already deleted. [ 621.186127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b88f7e9-d6da-4d0b-906f-8fbb0f644e6f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.217647] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c33b7aa-f311-4557-a5d9-b373ffed03e2 with status ACTIVE [ 621.217872] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.218021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.218090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.218409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.218758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.218758] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.218908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.219031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.222059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.222059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.222059] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c33b7aa-f311-4557-a5d9-b373ffed03e2 is going to be updated. [ 621.242880] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.242880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.242880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.244199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.244199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.244199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c33b7aa-f311-4557-a5d9-b373ffed03e2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.324686] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ba4757a-7a28-45e2-851b-9eef7d051878 [ 621.325747] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.326247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.327311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.327630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.327817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.328043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ba4757a-7a28-45e2-851b-9eef7d051878 already deleted. [ 621.328373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ba4757a-7a28-45e2-851b-9eef7d051878" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.392443] env[65353]: INFO networking_nsxv3.common.synchronization [req-f0beab3a-6d8e-42ad-9d58-37ea027cff61 req-981f08a1-0ec8-497a-998f-c2bd9ad3ac06 tempest-FloatingIPsAssociationNegativeTestJSON-719006263 tempest-FloatingIPsAssociationNegativeTestJSON-719006263-project-member] Enqueued Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 621.392443] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 621.392443] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.393924] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.393924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.393924] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.879065] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.879065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.879065] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.879065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.880232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.880535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.880674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.880740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.883273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.883273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.883273] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.896288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.896288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.896288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.896288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.896288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.896288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.897112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.897112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.897112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.897112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.897112] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 101d7123-33df-4206-98ea-c31321fdee80 already deleted. [ 621.897458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.907867] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.908800] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.908933] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.909359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.909620] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.909769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.909876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.910101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.910239] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.910456] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.910560] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.910660] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.910757] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.910854] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.910947] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.911984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.931760] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.932016] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.932215] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.932443] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.932863] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.933102] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.933263] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.934025] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.934213] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d129c2b3-24b4-45ff-af4c-ffe1c8f037ef',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.387484] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.387484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.387484] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.437060] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.437301] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.437425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.437702] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.437850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.437998] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port d129c2b3-24b4-45ff-af4c-ffe1c8f037ef not found, creating... [ 622.438273] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.438433] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.438544] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.438755] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.438886] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.439177] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.439323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.439431] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.439631] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.439867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.439942] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: d129c2b3-24b4-45ff-af4c-ffe1c8f037ef is going to be created. [ 622.462081] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.462276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.462404] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.462747] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.463189] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.463301] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.653486] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4577ecd5-72b3-4609-9f38-c7fd021eb0e9 None None] Enqueued Resource ID: 12c80c12-30e6-46f3-a50c-ab0b8e2eee6a with Priority: HIGHEST for action port [ 622.654141] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c80c12-30e6-46f3-a50c-ab0b8e2eee6a with Priority: HIGHEST for action port [ 622.654905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-12c80c12-30e6-46f3-a50c-ab0b8e2eee6a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.655100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12c80c12-30e6-46f3-a50c-ab0b8e2eee6a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.655148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12c80c12-30e6-46f3-a50c-ab0b8e2eee6a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.655478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12c80c12-30e6-46f3-a50c-ab0b8e2eee6a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.655683] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12c80c12-30e6-46f3-a50c-ab0b8e2eee6a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.699867] env[65353]: INFO networking_nsxv3.common.synchronization [None req-091f0fc3-4adc-4a14-a428-f06bcc2a82a1 None None] Enqueued Resource ID: 5eeb5e60-fc08-4a76-954e-20c039046055 with Priority: HIGHEST for action port [ 622.700873] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eeb5e60-fc08-4a76-954e-20c039046055 with Priority: HIGHEST for action port [ 622.702114] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5eeb5e60-fc08-4a76-954e-20c039046055 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.702114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5eeb5e60-fc08-4a76-954e-20c039046055" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.702114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5eeb5e60-fc08-4a76-954e-20c039046055" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.702114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5eeb5e60-fc08-4a76-954e-20c039046055" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.702114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5eeb5e60-fc08-4a76-954e-20c039046055',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.889334] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.146497] env[65353]: INFO networking_nsxv3.common.synchronization [req-f0beab3a-6d8e-42ad-9d58-37ea027cff61 req-0bc49e04-1c4c-4380-a6c7-967a1a61f72a service nova] Enqueued Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_rules [ 623.146497] env[65353]: INFO networking_nsxv3.common.synchronization [req-f0beab3a-6d8e-42ad-9d58-37ea027cff61 req-0bc49e04-1c4c-4380-a6c7-967a1a61f72a service nova] Enqueued Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 623.146497] env[65353]: INFO networking_nsxv3.common.synchronization [req-f0beab3a-6d8e-42ad-9d58-37ea027cff61 req-0bc49e04-1c4c-4380-a6c7-967a1a61f72a service nova] Enqueued Resource ID: d129c2b3-24b4-45ff-af4c-ffe1c8f037ef with Priority: HIGHEST for action port [ 623.146497] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_rules [ 623.147339] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 623.147422] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d129c2b3-24b4-45ff-af4c-ffe1c8f037ef with Priority: HIGHEST for action port [ 623.147752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.147928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.148051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.148753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.148753] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.150298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.150895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.151037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.151315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.152373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.152373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.152373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.152373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.152373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.152373] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.153749] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.153749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.153749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.156287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.156287] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d129c2b3-24b4-45ff-af4c-ffe1c8f037ef',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.157782] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12c80c12-30e6-46f3-a50c-ab0b8e2eee6a [ 623.157782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.159630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.159630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.159630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.159630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.159630] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12c80c12-30e6-46f3-a50c-ab0b8e2eee6a already deleted. [ 623.159630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12c80c12-30e6-46f3-a50c-ab0b8e2eee6a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.204674] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5eeb5e60-fc08-4a76-954e-20c039046055 [ 623.204674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.204674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.204674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.205323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.205596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.205787] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5eeb5e60-fc08-4a76-954e-20c039046055 already deleted. [ 623.206782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5eeb5e60-fc08-4a76-954e-20c039046055" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.391555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.391732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.391797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.393642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.393642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.393642] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 623.428136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.428136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.428136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.428136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.428136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.437117] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 623.637076] env[65353]: INFO networking_nsxv3.common.synchronization [req-fef5eac3-5e93-4223-854a-943d75badf7b req-3e353636-6c44-4018-9e95-a8f122f94c8b tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 623.637579] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 623.637920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.638523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.638523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.638714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.638878] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.638978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.639056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.639284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.639383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.639429] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.658404] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.659179] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.659402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.659897] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d129c2b3-24b4-45ff-af4c-ffe1c8f037ef with status ACTIVE [ 623.660083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.660197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.660260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.661181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.661181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.661181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.661181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.661181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.662379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.662379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.662556] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.662638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.662689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.662930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.662930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.663075] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d129c2b3-24b4-45ff-af4c-ffe1c8f037ef is going to be updated. [ 623.689100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.689300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.689300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.689516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.689653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.689810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d129c2b3-24b4-45ff-af4c-ffe1c8f037ef" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.142783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.142783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.142783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.143365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.143365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.143858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.143858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.143858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.143858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.144490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.144675] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f already deleted. [ 624.144847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.161059] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.338424] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.338624] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.338728] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.339098] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.339409] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.339635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.339778] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.340044] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.340192] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.340427] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.340537] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.340660] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.340856] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.340856] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.341101] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.341101] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.364362] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.364540] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.364730] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.364928] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.365352] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-6931634d-4a1b-4f29-a5d3-aa45c7387f96 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.365701] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.365897] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.366251] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.366442] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6931634d-4a1b-4f29-a5d3-aa45c7387f96',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.664321] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.664548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.664548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.664769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.664930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.665050] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 101d7123-33df-4206-98ea-c31321fdee80 is going to be created. [ 624.691627] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.691826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.691826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.691959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.692329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.702346] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: UNINITIALIZED for 2s [ 624.868935] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.869390] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.869547] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.869894] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.870088] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.870415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 6931634d-4a1b-4f29-a5d3-aa45c7387f96 not found, creating... [ 624.870614] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.870785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.870899] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.871401] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.872843] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.873249] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873637] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873878] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.874122] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.874376] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.874632] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 6931634d-4a1b-4f29-a5d3-aa45c7387f96 is going to be created. [ 624.896151] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.896381] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.896489] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896778] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.897986] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.898235] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.949637] env[65353]: INFO networking_nsxv3.common.synchronization [None req-86157e32-12e1-4799-9689-685aa761d55a None None] Enqueued Resource ID: 50caaf1e-4974-4dc0-b5a9-75e57ba3216e with Priority: HIGHEST for action port [ 624.950303] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50caaf1e-4974-4dc0-b5a9-75e57ba3216e with Priority: HIGHEST for action port [ 624.950633] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-50caaf1e-4974-4dc0-b5a9-75e57ba3216e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.950758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50caaf1e-4974-4dc0-b5a9-75e57ba3216e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.950913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50caaf1e-4974-4dc0-b5a9-75e57ba3216e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.951102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50caaf1e-4974-4dc0-b5a9-75e57ba3216e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.951286] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50caaf1e-4974-4dc0-b5a9-75e57ba3216e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.281681] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ffcfd694-3351-4b21-8966-7461c2bf48c5 None None] Enqueued Resource ID: 31598542-a0b5-4823-ab37-93f3892142c5 with Priority: HIGHEST for action port [ 625.282356] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31598542-a0b5-4823-ab37-93f3892142c5 with Priority: HIGHEST for action port [ 625.282471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-31598542-a0b5-4823-ab37-93f3892142c5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.282824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31598542-a0b5-4823-ab37-93f3892142c5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.282906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31598542-a0b5-4823-ab37-93f3892142c5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.283683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31598542-a0b5-4823-ab37-93f3892142c5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.283817] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31598542-a0b5-4823-ab37-93f3892142c5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.449372] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 625.449372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.449372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.449577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.449614] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.451666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.451666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.451666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.451666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.451666] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.453722] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50caaf1e-4974-4dc0-b5a9-75e57ba3216e [ 625.453974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.454098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.454170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.461030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.461030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.461030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50caaf1e-4974-4dc0-b5a9-75e57ba3216e already deleted. [ 625.461030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50caaf1e-4974-4dc0-b5a9-75e57ba3216e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.707754] env[65353]: INFO networking_nsxv3.common.synchronization [req-fef5eac3-5e93-4223-854a-943d75badf7b req-826c6fc4-6842-46ee-9778-be52a7993c51 service nova] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_rules [ 625.707937] env[65353]: INFO networking_nsxv3.common.synchronization [req-fef5eac3-5e93-4223-854a-943d75badf7b req-826c6fc4-6842-46ee-9778-be52a7993c51 service nova] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 625.708084] env[65353]: INFO networking_nsxv3.common.synchronization [req-fef5eac3-5e93-4223-854a-943d75badf7b req-826c6fc4-6842-46ee-9778-be52a7993c51 service nova] Enqueued Resource ID: 6931634d-4a1b-4f29-a5d3-aa45c7387f96 with Priority: HIGHEST for action port [ 625.708652] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_rules [ 625.708772] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 625.708870] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6931634d-4a1b-4f29-a5d3-aa45c7387f96 with Priority: HIGHEST for action port [ 625.709611] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.709748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.709793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.710061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.710153] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.711069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.711539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.711539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.711539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.712265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.712265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.713279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.713279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.713279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.713279] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.714262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6931634d-4a1b-4f29-a5d3-aa45c7387f96 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.714373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.714373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.714539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.714640] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6931634d-4a1b-4f29-a5d3-aa45c7387f96',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.787882] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31598542-a0b5-4823-ab37-93f3892142c5 [ 625.787882] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.787882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.787882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.787882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.788192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.788192] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31598542-a0b5-4823-ab37-93f3892142c5 already deleted. [ 625.788257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31598542-a0b5-4823-ab37-93f3892142c5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.955983] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.103994] env[65353]: INFO networking_nsxv3.common.synchronization [req-a1a9ef1a-ce7b-4616-a2ed-142a6b2826e6 req-14795ebe-1ab0-4dda-9955-38a54b1d77de tempest-FloatingIPsAssociationTestJSON-1151398823 tempest-FloatingIPsAssociationTestJSON-1151398823-project-member] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 626.103994] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 626.103994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.103994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.103994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.103994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.104823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.104976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.105106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.105817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.105817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.105817] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.218772] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6931634d-4a1b-4f29-a5d3-aa45c7387f96 with status ACTIVE [ 626.218772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.218973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.219830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.222503] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.222503] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.222503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.222503] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6931634d-4a1b-4f29-a5d3-aa45c7387f96 is going to be updated. [ 626.223430] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.224723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.225739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.250031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.250186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.250240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.250460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.250599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.250837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6931634d-4a1b-4f29-a5d3-aa45c7387f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.460361] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.524170] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.524413] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.524555] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.526051] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.526051] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.526223] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.526363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.526726] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.526902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.527204] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.527934] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.528116] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.528287] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.528428] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.528570] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.528717] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.552821] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.553021] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.553150] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.553349] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.553724] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.553925] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.554092] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.556876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.556876] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.609239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.609239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.609239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.609239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.609239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.609239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.609239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.609845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.609845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.609845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.609845] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a already deleted. [ 626.609845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.715649] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: SUCCESS [ 626.715649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.715649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.715879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.715986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.716085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.716146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.716286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.716362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.716444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.716532] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.726292] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.962286] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.962422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.962500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.962701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.962785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.962880] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 626.991141] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.991363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.991453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.991634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.991799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.002741] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 627.058327] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.058635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.058769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.059113] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.059332] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.059524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f not found, creating... [ 627.059841] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.060048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.060221] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.060546] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.060645] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.060994] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.061165] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.061286] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.061512] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.061646] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.061849] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f is going to be created. [ 627.082574] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.082574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.082574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.082749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.083132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.083173] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.222674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.222846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.222916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.223166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.223343] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.223446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.223508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.223652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.223736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.223821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.223962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.224265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.224404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.224677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.224751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.225015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.225015] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.228620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.228776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.228885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.229130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.229307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.229973] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be created. [ 627.258891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.259087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.259165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.259379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.259539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.271250] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: UNINITIALIZED for 2s [ 627.413845] env[65353]: INFO networking_nsxv3.common.synchronization [None req-704f9a29-c9bc-4922-a19f-3367d029e4f3 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 627.414468] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 627.414794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.414794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.414893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.415114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.415235] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.634867] env[65353]: INFO networking_nsxv3.common.synchronization [None req-99b479f4-86a3-4689-b25b-3bff4ffda1fc tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 627.635408] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 627.635757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.635859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.727663] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 101d7123-33df-4206-98ea-c31321fdee80: rpc.has_security_group_logging(os_id): False [ 627.749947] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.750132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.750190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.750446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.750541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.750763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.750860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.750918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.751140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.751247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.751457] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.751561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.751617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.751749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.751808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.751994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.752120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.752183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.752326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.752394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.752485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 101d7123-33df-4206-98ea-c31321fdee80 is going to be created. [ 627.869847] env[65353]: INFO networking_nsxv3.common.synchronization [req-a1a9ef1a-ce7b-4616-a2ed-142a6b2826e6 req-93cdd973-e046-4009-9a23-6ad1d841f636 service nova] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_rules [ 627.871123] env[65353]: INFO networking_nsxv3.common.synchronization [req-a1a9ef1a-ce7b-4616-a2ed-142a6b2826e6 req-93cdd973-e046-4009-9a23-6ad1d841f636 service nova] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 627.871123] env[65353]: INFO networking_nsxv3.common.synchronization [req-a1a9ef1a-ce7b-4616-a2ed-142a6b2826e6 req-93cdd973-e046-4009-9a23-6ad1d841f636 service nova] Enqueued Resource ID: d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f with Priority: HIGHEST for action port [ 627.871608] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_rules [ 627.871850] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 627.872076] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f with Priority: HIGHEST for action port [ 627.872490] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.873947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.873947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.873947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.873947] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.875030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.875030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.875030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.875030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.875030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.875658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.876224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.876224] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.876905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.877029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.877430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.877738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.877801] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.882321] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.882473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.882557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.882782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.882999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.901584] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: IN_PROGRESS for 2s [ 627.948043] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.948043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.948043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.948043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.948043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.948043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 already deleted. [ 627.948043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.949737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.949737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.949737] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.101889] env[65353]: INFO networking_nsxv3.common.synchronization [None req-20832ab8-eab0-4dab-bde8-c3b441c6290f None None] Enqueued Resource ID: fb2dbd34-74bb-4ac7-9fba-6a58b021d95a with Priority: HIGHEST for action port [ 628.101889] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2dbd34-74bb-4ac7-9fba-6a58b021d95a with Priority: HIGHEST for action port [ 628.102567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb2dbd34-74bb-4ac7-9fba-6a58b021d95a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.102680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb2dbd34-74bb-4ac7-9fba-6a58b021d95a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.102680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb2dbd34-74bb-4ac7-9fba-6a58b021d95a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.102969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb2dbd34-74bb-4ac7-9fba-6a58b021d95a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.104126] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb2dbd34-74bb-4ac7-9fba-6a58b021d95a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.380014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.380193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.380404] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.386167] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f with status ACTIVE [ 628.386448] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.386634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.386717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.386942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.387046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.387227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.387327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.388675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.388675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.388675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.388859] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.389053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.389666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.389666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.389666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.389933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f is going to be updated. [ 628.415290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.415469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.415575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.415817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.415970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.416226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c23a2d-8ba6-4b83-9ea6-563a8af9fb2f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.471399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.471399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.471399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.471399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.471399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.471602] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 already deleted. [ 628.471633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.483765] env[65353]: INFO networking_nsxv3.common.synchronization [req-15ec4a95-2ae3-4d97-8433-dc10fb483ecf req-8a29b46c-00f2-47cb-b8e8-30b662e856ba tempest-ServerDiagnosticsNegativeTest-824436268 tempest-ServerDiagnosticsNegativeTest-824436268-project-member] Enqueued Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 628.483765] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 628.483765] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.483765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.483765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.496469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.496469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.496469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.496469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.496469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.496469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.496469] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.605693] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb2dbd34-74bb-4ac7-9fba-6a58b021d95a [ 628.606348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.606348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.606348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.606348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.606348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.606585] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb2dbd34-74bb-4ac7-9fba-6a58b021d95a already deleted. [ 628.606585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb2dbd34-74bb-4ac7-9fba-6a58b021d95a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.882778] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.894068] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.894068] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.894068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.894068] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.894068] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.894068] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.894068] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.894625] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.894625] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.894625] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.916910] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.917123] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.917272] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.917399] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.917840] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-337eb4a4-5e5a-44da-b861-8eb90d3d041e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.918042] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.918150] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.918565] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.918700] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337eb4a4-5e5a-44da-b861-8eb90d3d041e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.998618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.998885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.999018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.999338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.999529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.999675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.999746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.999859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.999999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.000102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.000221] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 already deleted. [ 629.000333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.015544] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 629.017132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.017132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.017132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.017132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.017132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.017708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.017708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017708] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.017708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.019428] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.019428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.019428] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.287681] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 629.290159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.290159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.290159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.290291] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.290433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.290511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.290692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.290788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.290889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.290995] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.385063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.385259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.385307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.385505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.385598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.385691] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be created. [ 629.411166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.411388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.411444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.411653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.411811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.421493] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: UNINITIALIZED for 2s [ 629.422043] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.422309] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.422444] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.422707] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.422898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.422981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 337eb4a4-5e5a-44da-b861-8eb90d3d041e not found, creating... [ 629.423245] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.423395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.423552] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.423721] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.423846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.424125] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.424273] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.424382] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.424579] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.424706] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.424829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 337eb4a4-5e5a-44da-b861-8eb90d3d041e is going to be created. [ 629.444951] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.445175] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.445353] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.445686] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.445914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.446162] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.522152] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0209ced-141c-4ff9-b95c-1f2fc770b1f0: rpc.has_security_group_logging(os_id): False [ 629.555675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.555675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.555905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.555979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.556081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.556274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.556375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.556437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.556979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.556979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.556979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.556979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.557191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.557222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.557321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.557525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.557631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.557689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.557828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.557893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.557977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be created. [ 629.635930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.636144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.636189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.636474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.637406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.651459] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 629.797858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.798102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.798102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.798332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.798497] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.798596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.798660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.798806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.798911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.798995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.799216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.799311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.799374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.799520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.799652] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.799739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.799798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.799932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.800010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.800092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.800178] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.914119] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: SUCCESS [ 629.914480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.139569] env[65353]: INFO networking_nsxv3.common.synchronization [req-15ec4a95-2ae3-4d97-8433-dc10fb483ecf req-002a20b4-71a8-4ac3-8b2d-53f9e3832cf7 service nova] Enqueued Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_rules [ 630.139758] env[65353]: INFO networking_nsxv3.common.synchronization [req-15ec4a95-2ae3-4d97-8433-dc10fb483ecf req-002a20b4-71a8-4ac3-8b2d-53f9e3832cf7 service nova] Enqueued Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 630.139893] env[65353]: INFO networking_nsxv3.common.synchronization [req-15ec4a95-2ae3-4d97-8433-dc10fb483ecf req-002a20b4-71a8-4ac3-8b2d-53f9e3832cf7 service nova] Enqueued Resource ID: 337eb4a4-5e5a-44da-b861-8eb90d3d041e with Priority: HIGHEST for action port [ 630.140466] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_rules [ 630.140603] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 630.140700] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337eb4a4-5e5a-44da-b861-8eb90d3d041e with Priority: HIGHEST for action port [ 630.141728] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.141936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.142052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.142357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.142537] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.144620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.144620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.144620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.144620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.144620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.144620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.144620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.144924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.144924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.145019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.145859] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-337eb4a4-5e5a-44da-b861-8eb90d3d041e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.146041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.146141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.146380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.146483] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337eb4a4-5e5a-44da-b861-8eb90d3d041e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.306243] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77899b4e-41ba-45bf-ac89-22e780314f5f: rpc.has_security_group_logging(os_id): False [ 630.326594] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.326757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.326893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.327062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.327156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.327375] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.327468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.327880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.327880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.327880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.328032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.328032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.328109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.329724] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.329724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.329724] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be created. [ 630.393700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.393878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.393922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.394129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.394307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.408376] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 630.648150] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.651555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.651687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.651833] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 337eb4a4-5e5a-44da-b861-8eb90d3d041e with status ACTIVE [ 630.652280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.652280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.652280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.652475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.652568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.652710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.652865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.652865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.655378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.655473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.656023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.656023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.656023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.656023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.656246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.656246] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 337eb4a4-5e5a-44da-b861-8eb90d3d041e is going to be updated. [ 630.679787] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.681177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.681177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.681177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.681370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.681652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-337eb4a4-5e5a-44da-b861-8eb90d3d041e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.722727] env[65353]: INFO networking_nsxv3.common.synchronization [req-c1e397e8-2f12-4ef7-a952-016b27e42e2f req-26178ba1-7d8d-4aec-90dc-891a8d5c3e17 tempest-VolumesAssistedSnapshotsTest-350081951 tempest-VolumesAssistedSnapshotsTest-350081951-project-member] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 630.726329] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 630.727123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.727123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.727123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.729285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.729285] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.729285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.729285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.729285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.729285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.729285] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.874286] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4bb8c4c6-5abb-46fb-9017-e6fde004f4cb None None] Enqueued Resource ID: 24881c9d-10fd-4842-8950-d4293e524497 with Priority: HIGHEST for action port [ 630.874640] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24881c9d-10fd-4842-8950-d4293e524497 with Priority: HIGHEST for action port [ 630.875194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-24881c9d-10fd-4842-8950-d4293e524497 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.875434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24881c9d-10fd-4842-8950-d4293e524497" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.875621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24881c9d-10fd-4842-8950-d4293e524497" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.875879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24881c9d-10fd-4842-8950-d4293e524497" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.876394] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24881c9d-10fd-4842-8950-d4293e524497',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.154255] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.184019] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-655" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-655" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-655" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.184019] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.184019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.184019] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.184019] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.184824] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.184972] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.185105] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.185209] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.185338] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.204367] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.204556] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.204650] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.204820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-655" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.205146] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-08804c1a-74f8-43a9-b335-33ff68410acb taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.205313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.205427] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.205740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.205875] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08804c1a-74f8-43a9-b335-33ff68410acb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.230318] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.230467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.231330] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.231330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.231592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.231592] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 already deleted. [ 631.231592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.380622] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24881c9d-10fd-4842-8950-d4293e524497 [ 631.380826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.381019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.381211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.381552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.381820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.381820] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24881c9d-10fd-4842-8950-d4293e524497 already deleted. [ 631.382131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24881c9d-10fd-4842-8950-d4293e524497" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.436210] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 631.436337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.436553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.436826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.436982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.437129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.437198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.437380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.437458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.437538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.437646] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.659289] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.659289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.659289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.659289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.659289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.659289] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 is going to be created. [ 631.669345] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 631.669990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.671776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.671776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.671776] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.697463] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.697933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.698193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.698887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.698887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.710741] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.711652] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.711652] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.711652] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.711916] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.711916] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 08804c1a-74f8-43a9-b335-33ff68410acb not found, creating... [ 631.712181] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.712611] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.712611] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.712782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.713395] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.713395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.713395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.713820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.714916] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.714916] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 08804c1a-74f8-43a9-b335-33ff68410acb is going to be created. [ 631.716526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: UNINITIALIZED for 2s [ 631.744206] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.745615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.745615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.745615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.745970] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.746595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.944409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.944837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.944934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.945430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.945724] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.945962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.945962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.946207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.946291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.946386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.946663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.946790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.946854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.947061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.947227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.947324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.947606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.947822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.947941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.948321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.948651] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.173025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.173359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.173359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.174059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.174059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.174059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.174059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.174250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.174250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.174318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.174389] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.423133] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 632.423397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.452131] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27ce0226-fe63-4c32-b41f-c2e799ff5d0a: rpc.has_security_group_logging(os_id): False [ 632.476575] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.476575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.476750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.476897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.477040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.477269] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.477858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.477858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.477858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.477858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.478075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.478075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.478075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.478202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.478515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.478515] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.478745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.478745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.478745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.478866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.478923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be created. [ 632.489965] env[65353]: INFO networking_nsxv3.common.synchronization [req-c1e397e8-2f12-4ef7-a952-016b27e42e2f req-2cec6d52-9811-4532-b5e3-9ffcde8de4ee service nova] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 632.489965] env[65353]: INFO networking_nsxv3.common.synchronization [req-c1e397e8-2f12-4ef7-a952-016b27e42e2f req-2cec6d52-9811-4532-b5e3-9ffcde8de4ee service nova] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 632.489965] env[65353]: INFO networking_nsxv3.common.synchronization [req-c1e397e8-2f12-4ef7-a952-016b27e42e2f req-2cec6d52-9811-4532-b5e3-9ffcde8de4ee service nova] Enqueued Resource ID: 08804c1a-74f8-43a9-b335-33ff68410acb with Priority: HIGHEST for action port [ 632.491394] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_rules [ 632.491394] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 632.491394] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08804c1a-74f8-43a9-b335-33ff68410acb with Priority: HIGHEST for action port [ 632.491394] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.491394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.492141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.492400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.492509] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.493722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.494955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.494955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.495114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.496221] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.496221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.496221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.496221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.496221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.496221] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.497022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-08804c1a-74f8-43a9-b335-33ff68410acb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.497022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.497022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.497649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.497649] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08804c1a-74f8-43a9-b335-33ff68410acb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.553033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.554714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.555380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.555380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.555380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.570415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 632.677489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.681022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.681022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.681022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.681022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.681910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.681910] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.002558] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08804c1a-74f8-43a9-b335-33ff68410acb with status ACTIVE [ 633.002558] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.002754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.002754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.003192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.003192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.003415] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.003415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.003415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.003613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.003613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.003764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.003901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.003958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.004083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.004164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.004233] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08804c1a-74f8-43a9-b335-33ff68410acb is going to be updated. [ 633.009379] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.009634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.009902] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.040634] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.040991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.040991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.041123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.041370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.041443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08804c1a-74f8-43a9-b335-33ff68410acb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.192322] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0209ced-141c-4ff9-b95c-1f2fc770b1f0: rpc.has_security_group_logging(os_id): False [ 633.192322] env[65353]: INFO networking_nsxv3.common.synchronization [req-36aa17cb-a778-4819-b82a-6977215d53e4 req-57d00ec2-d4a1-4fee-87b8-731201714840 tempest-ServerDiagnosticsTest-669480676 tempest-ServerDiagnosticsTest-669480676-project-member] Enqueued Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 633.192789] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 633.193421] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.193626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.193698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.193967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.194559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.194559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.194559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.194559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.195572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.195572] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.218520] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.218815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.218815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.219061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.219222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.219489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.219599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.219695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.219909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.220036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.220262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.220897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.220999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.221227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.221328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.221626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.222031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.222031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.222031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.222244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.222244] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 633.298560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.298642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.298684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.298902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.299070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.314354] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 633.515090] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.650247] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.650668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.650830] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.651112] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.651677] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.651881] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.652009] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.652255] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.652734] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.652965] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.653085] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.653187] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.653285] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.653417] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.653483] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.654137] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.674091] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.674391] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.674491] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.674736] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.675141] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-7a0da014-53c6-4618-a23f-a32f6b7aade0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.675363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.675517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.676522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.677237] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a0da014-53c6-4618-a23f-a32f6b7aade0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.682810] env[65353]: INFO networking_nsxv3.common.synchronization [None req-eb569926-36af-4fb8-ac9b-2c56ebfe84f3 None None] Enqueued Resource ID: fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d with Priority: HIGHEST for action port [ 633.682810] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d with Priority: HIGHEST for action port [ 633.682810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.682810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.682810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.683226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.683429] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.698266] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.698596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.698865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.699091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.699402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.699845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.700082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.700208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.700541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.700685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.700808] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e already deleted. [ 633.700940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.725796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: SUCCESS [ 633.725929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.726146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.726634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.726634] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.726783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.726783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.726999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.727100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.727189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.727337] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.793093] env[65353]: INFO networking_nsxv3.common.synchronization [req-32fe5d87-746a-4a13-a46c-edaee463d98d req-f286b0b2-0a10-4f46-a3f0-ff04dd862845 tempest-DeleteServersAdminTestJSON-280197798 tempest-DeleteServersAdminTestJSON-280197798-project-admin] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 633.793504] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 633.794092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.794092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.794092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.794274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.794396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.794534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.794597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.794746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.794847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.794939] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.019988] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.020353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.020353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.020445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.022514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.022514] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 is going to be created. [ 634.045314] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.045515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.045552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.045761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.045918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.057714] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: UNINITIALIZED for 2s [ 634.180765] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.181026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.181119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.181484] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.182013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.182013] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 7a0da014-53c6-4618-a23f-a32f6b7aade0 not found, creating... [ 634.182119] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.182344] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.182548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.182810] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.183282] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.183347] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.183829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.183829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.183829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.184050] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.185534] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 7a0da014-53c6-4618-a23f-a32f6b7aade0 is going to be created. [ 634.185534] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d [ 634.186056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.186056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.186056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.186345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.186490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.186747] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d already deleted. [ 634.186747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc3a4fcb-d6c7-42b7-9450-bf4af3063a7d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.210886] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.211687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.211687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.211687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.211821] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.212059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.229885] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.230120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.230163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.230436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.230687] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.230816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.230886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.231068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.231158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.231247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.231472] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.231609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.231652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.231798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.232046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.232046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.232155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.232283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.232369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.232488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.232581] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.297510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.298716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.298907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.299299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.299392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.299668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.299760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.299792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.299952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.300074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.300133] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be updated. [ 634.349835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.350060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.350192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.350469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.350657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.364612] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 634.585171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 634.585467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.735457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531: rpc.has_security_group_logging(os_id): False [ 634.755810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.755980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.756082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.756302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.756405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.756620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.756729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.756782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.756960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.757052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.757236] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.757345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.757420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.757642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.757727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.757928] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.758954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.759202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.759427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.759531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.759651] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 is going to be created. [ 634.891028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.891028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.891028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.891028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.891028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.910299] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: IN_PROGRESS for 2s [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [req-36aa17cb-a778-4819-b82a-6977215d53e4 req-bd90f87b-9631-4de7-b6d0-ab47ca5e8bec service nova] Enqueued Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_rules [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [req-36aa17cb-a778-4819-b82a-6977215d53e4 req-bd90f87b-9631-4de7-b6d0-ab47ca5e8bec service nova] Enqueued Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [req-36aa17cb-a778-4819-b82a-6977215d53e4 req-bd90f87b-9631-4de7-b6d0-ab47ca5e8bec service nova] Enqueued Resource ID: 7a0da014-53c6-4618-a23f-a32f6b7aade0 with Priority: HIGHEST for action port [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_rules [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 634.963320] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0da014-53c6-4618-a23f-a32f6b7aade0 with Priority: HIGHEST for action port [ 634.963320] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.963320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.963320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.965081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.965343] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.966752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.967163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.967394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.968113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.968456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.970020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.970020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.970020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.970020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.970020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.970581] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a0da014-53c6-4618-a23f-a32f6b7aade0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.971515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.971515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.971804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.972502] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a0da014-53c6-4618-a23f-a32f6b7aade0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.135867] env[65353]: INFO networking_nsxv3.common.synchronization [req-053d7530-fd79-4fd3-902b-8f22c67e65a5 req-ea415f76-0f5b-4628-ba80-768047c8a499 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 635.135867] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 635.136082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.136198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.136264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.136517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.136672] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.136762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.140746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.141546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.141546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.141546] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.334234] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 635.334641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.475829] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.476767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.476767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.477129] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a0da014-53c6-4618-a23f-a32f6b7aade0 with status ACTIVE [ 635.477304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.477413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.477476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.478461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.478461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.478461] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.478461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.478461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.478708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.479299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.479675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.479675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.479794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.479964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.480185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.481320] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a0da014-53c6-4618-a23f-a32f6b7aade0 is going to be updated. [ 635.508179] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.508179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.508179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.508179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.508179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.508179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a0da014-53c6-4618-a23f-a32f6b7aade0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.509409] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.509902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.510771] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.510771] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.511744] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.512209] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.512627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.513525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.513525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.513525] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.513525] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.516797] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.516797] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.516797] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.516797] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.516797] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.537982] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.538539] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.538834] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.539236] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.539841] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.540269] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.540522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.540965] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.541234] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.647510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.648739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.648739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.648860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.648897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.649992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.650135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.650223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.650406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.650504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.650610] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee already deleted. [ 635.650703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.977835] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.044077] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.044305] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.044432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.044746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.044925] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.045090] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 not found, creating... [ 636.045339] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.045486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.045596] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.045802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.045926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.046287] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.046443] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.046548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.046748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.046873] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.047016] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 is going to be created. [ 636.070933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: SUCCESS [ 636.070933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.070933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.071523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.071523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.071687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.071770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.071980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.072110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.072189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.072311] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.074426] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.074689] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.074819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.075096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.075312] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.075532] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.375037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 636.375653] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 deletion is rescheduled due to dependency. [ 636.375653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.481540] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.481540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.481540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.481777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.481777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.481923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e is going to be created. [ 636.508595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.508595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.508595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.508595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.509378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.519359] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: UNINITIALIZED for 2s [ 636.578403] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.809741] env[65353]: INFO networking_nsxv3.common.synchronization [req-053d7530-fd79-4fd3-902b-8f22c67e65a5 req-7bba4c87-dad5-4309-9aae-39865d3b6f88 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 636.809979] env[65353]: INFO networking_nsxv3.common.synchronization [req-053d7530-fd79-4fd3-902b-8f22c67e65a5 req-7bba4c87-dad5-4309-9aae-39865d3b6f88 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 636.810585] env[65353]: INFO networking_nsxv3.common.synchronization [req-053d7530-fd79-4fd3-902b-8f22c67e65a5 req-7bba4c87-dad5-4309-9aae-39865d3b6f88 service nova] Enqueued Resource ID: 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 with Priority: HIGHEST for action port [ 636.811144] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 636.811590] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 636.811756] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 with Priority: HIGHEST for action port [ 636.812402] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.812402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.812402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.813142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.813142] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.816567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.816567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.816567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.816567] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.818381] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.818500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.818555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.818728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.818815] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.926442] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: SUCCESS [ 636.926819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.084369] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9504e678-5653-4fec-9797-d96edd9ac6e9: rpc.has_security_group_logging(os_id): False [ 637.109252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.109428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.109497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.109713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.109815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.110075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.110177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.111029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.111236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.111881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.111978] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 is going to be created. [ 637.195583] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.195832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.195920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.196416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.196416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.214268] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: IN_PROGRESS for 2s [ 637.317986] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.323080] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 with status ACTIVE [ 637.323330] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.323935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.323935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.323935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.323935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.324320] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.325114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.325212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.326416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.326552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.326749] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.326861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.326924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.327200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.327621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.327621] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4 is going to be updated. [ 637.329816] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.329996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.359016] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.359232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.359290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.359627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.359865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.360160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c49f2a3-67e2-4630-8e69-86e0ccb2fcc4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.480240] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ef3c99c-946b-4645-a80c-bfe845dfce26 req-b0024dd3-5c41-41ac-8e2c-329ec13112ed tempest-VolumesAdminNegativeTest-448169051 tempest-VolumesAdminNegativeTest-448169051-project-member] Enqueued Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 637.480240] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 637.481131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.481659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.481882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.482286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.482605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.482836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.483025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.483298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.483473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.484421] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.822845] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.988640] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.988865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.989096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.989256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.989413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.989827] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.990036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.990036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.990383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.990383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.990383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b already deleted. [ 637.990560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.079059] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-858 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.079059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-858" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.079059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-858" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.079059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-858" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.079544] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.079544] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.079544] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.079683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.080733] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.080982] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.081251] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.081251] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.081510] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.081510] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.081613] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.081726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.103731] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.103731] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.103834] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.103963] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-858" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.104316] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-b9028315-9b87-4c03-beb9-489e2418ac47 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.104488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.104604] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.104945] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.105091] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9028315-9b87-4c03-beb9-489e2418ac47',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.328017] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.328017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.328017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.328017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.328017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.328017] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be created. [ 638.357563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.357818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.357920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.358166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.358332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.369166] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: UNINITIALIZED for 2s [ 638.535970] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: SUCCESS [ 638.536444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.536950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.537394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.537881] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.538280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.538628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.539024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.539304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.539726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.539926] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.608672] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.608974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.609129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.609473] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.609867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.610093] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port b9028315-9b87-4c03-beb9-489e2418ac47 not found, creating... [ 638.610469] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.610632] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.610745] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.611813] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.612097] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.612934] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.613214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.613505] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.613913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.614186] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.614466] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: b9028315-9b87-4c03-beb9-489e2418ac47 is going to be created. [ 638.637986] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.638257] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.638333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.638613] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.638828] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.639059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.043618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.043786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.043854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.044115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.044292] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.044396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.044460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.044608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.044695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.044779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.044924] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.045018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.045079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.045221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.045373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.045479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.045536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.045679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.045768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.045850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.045939] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.227289] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: SUCCESS [ 639.228506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ef3c99c-946b-4645-a80c-bfe845dfce26 req-a38172a3-03f9-4651-822e-bc8fa0c81783 service nova] Enqueued Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_rules [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ef3c99c-946b-4645-a80c-bfe845dfce26 req-a38172a3-03f9-4651-822e-bc8fa0c81783 service nova] Enqueued Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ef3c99c-946b-4645-a80c-bfe845dfce26 req-a38172a3-03f9-4651-822e-bc8fa0c81783 service nova] Enqueued Resource ID: b9028315-9b87-4c03-beb9-489e2418ac47 with Priority: HIGHEST for action port [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_rules [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 639.339194] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9028315-9b87-4c03-beb9-489e2418ac47 with Priority: HIGHEST for action port [ 639.339651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.339908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.340073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.340421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.340666] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.342149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.342462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.342595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.342875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.343189] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.343523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.343764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.343995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.344242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.344415] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.345993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9028315-9b87-4c03-beb9-489e2418ac47 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.346241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.346437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.346675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.347603] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9028315-9b87-4c03-beb9-489e2418ac47',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.550035] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82ad068a-08bf-42b7-b52d-4ee5bd2c752e: rpc.has_security_group_logging(os_id): False [ 639.569154] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.569154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.569154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.570033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.570198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.570506] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.570719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.570719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.572683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572683] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e is going to be created. [ 639.640707] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.640798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.640834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.641105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.641312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.656554] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: IN_PROGRESS for 2s [ 639.843252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.843467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.846967] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.849726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9028315-9b87-4c03-beb9-489e2418ac47 with status ACTIVE [ 639.849887] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.850267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.850267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.850417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.850974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.850974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.850974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.850974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.851260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.851260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.851396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.851486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.851549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.851697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.851780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.851848] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9028315-9b87-4c03-beb9-489e2418ac47 is going to be updated. [ 639.881911] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.882067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.882420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.882676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.882856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.883046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9028315-9b87-4c03-beb9-489e2418ac47" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.348814] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.382130] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 640.382341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.382939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.382939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.382939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.383324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.383324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.383324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.383477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.383477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.383673] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.857217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.857587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.857587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.857778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.857876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.858042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b is going to be created. [ 640.889493] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.889662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.889720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.889950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.890383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.890383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.890383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.890578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.890578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.890706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.890795] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.890844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.890940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.891067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.891308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.891308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.891308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.892097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.892097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.892097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.892097] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.903466] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.903681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.903757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.904069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.904337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.922923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: UNINITIALIZED for 2s [ 641.394827] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef90e1f-f512-4c74-82f2-c918b64f5aee: rpc.has_security_group_logging(os_id): False [ 641.415119] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.415352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.415352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.415541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.415642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.415952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.415952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.416119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.416169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.416273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.416448] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.416526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.416597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.416828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.416828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.416935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.417032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.417092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.417216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.417280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.417401] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be created. [ 641.496086] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.496377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.496453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.496759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.497053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.516545] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 641.672234] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: SUCCESS [ 641.672506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.330300] env[65353]: INFO networking_nsxv3.common.synchronization [None req-cb730db9-8e87-4cc9-85e2-45fc45b4bb88 None None] Enqueued Resource ID: c094b1f6-4251-43da-91f1-c7eabd7fced1 with Priority: HIGHEST for action port [ 642.330300] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c094b1f6-4251-43da-91f1-c7eabd7fced1 with Priority: HIGHEST for action port [ 642.330985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c094b1f6-4251-43da-91f1-c7eabd7fced1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c094b1f6-4251-43da-91f1-c7eabd7fced1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.332655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c094b1f6-4251-43da-91f1-c7eabd7fced1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.334627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c094b1f6-4251-43da-91f1-c7eabd7fced1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.334627] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c094b1f6-4251-43da-91f1-c7eabd7fced1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.836157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c094b1f6-4251-43da-91f1-c7eabd7fced1 [ 642.836235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.836350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.836397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.837171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.837171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.837171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c094b1f6-4251-43da-91f1-c7eabd7fced1 already deleted. [ 642.837171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c094b1f6-4251-43da-91f1-c7eabd7fced1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.941435] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: SUCCESS [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.941435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.941435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.941435] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.446813] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.446813] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.446813] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.446813] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.446813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.447714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.447714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.447714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.447714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.447714] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.535118] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 643.535392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.791980] env[65353]: INFO networking_nsxv3.common.synchronization [req-11dba7b3-d2be-48d9-9a40-0eac288dac46 req-b145783e-e507-4189-96b3-0007fa467b25 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 643.793129] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 643.797027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.797027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.797027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.797027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.955562] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 364b11fe-318c-46b4-aed3-75bf7424303b: rpc.has_security_group_logging(os_id): False [ 643.982144] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.982339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.982339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.982668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.983067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.983145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.983238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.985399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.985399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.985399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.985399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.985767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.985767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.985873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.986824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.986824] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.986824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.986824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.986824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.986824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.988473] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b is going to be created. [ 644.065151] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.066746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.066746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.068388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.068388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.083768] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: IN_PROGRESS for 2s [ 644.286036] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.286036] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.286312] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.286475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.286784] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.287711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.287711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.287711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.287711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.288055] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.288055] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.288153] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.288214] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.288328] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.288462] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.288550] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.298041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.298363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.298363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.298527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.298585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.298772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.298879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.298937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.299083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.299163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.299236] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 already deleted. [ 644.299383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.313208] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.313461] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.313652] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.313930] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.314392] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.314654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.314824] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.315397] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.315618] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8135b80e-fa43-4b09-a5c5-d40ff2e7eef8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.818265] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.818692] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.818692] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.819154] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.819620] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.819825] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 not found, creating... [ 644.820198] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.820381] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.820563] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.820867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.820989] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.821566] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.821717] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.821717] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.821940] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.822129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.822308] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 is going to be created. [ 644.852965] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.853199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.853368] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.853687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.853954] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.854253] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.951118] env[65353]: INFO networking_nsxv3.common.synchronization [None req-27e9d31b-db9a-4673-8001-3020adee281a None None] Enqueued Resource ID: 6d04ac57-82af-4fa0-abef-24fdea322205 with Priority: HIGHEST for action port [ 644.951996] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d04ac57-82af-4fa0-abef-24fdea322205 with Priority: HIGHEST for action port [ 644.952389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d04ac57-82af-4fa0-abef-24fdea322205 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.952719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d04ac57-82af-4fa0-abef-24fdea322205" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.952856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d04ac57-82af-4fa0-abef-24fdea322205" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.953240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d04ac57-82af-4fa0-abef-24fdea322205" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.953354] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d04ac57-82af-4fa0-abef-24fdea322205',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.456622] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d04ac57-82af-4fa0-abef-24fdea322205 [ 645.456622] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.456622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.456622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.456622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.456622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.456622] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d04ac57-82af-4fa0-abef-24fdea322205 already deleted. [ 645.456622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d04ac57-82af-4fa0-abef-24fdea322205" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.608312] env[65353]: INFO networking_nsxv3.common.synchronization [req-11dba7b3-d2be-48d9-9a40-0eac288dac46 req-721f150a-d3c0-41ea-ae9c-5bd52ab7098f service nova] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 645.609079] env[65353]: INFO networking_nsxv3.common.synchronization [req-11dba7b3-d2be-48d9-9a40-0eac288dac46 req-721f150a-d3c0-41ea-ae9c-5bd52ab7098f service nova] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 645.609079] env[65353]: INFO networking_nsxv3.common.synchronization [req-11dba7b3-d2be-48d9-9a40-0eac288dac46 req-721f150a-d3c0-41ea-ae9c-5bd52ab7098f service nova] Enqueued Resource ID: 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 with Priority: HIGHEST for action port [ 645.609079] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_rules [ 645.609079] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 645.609079] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 with Priority: HIGHEST for action port [ 645.609601] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.609727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.609792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.609985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.610080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.611284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.611284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.611284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611549] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.611686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.611721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.612062] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.612840] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.612952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.613033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.617407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.617407] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8135b80e-fa43-4b09-a5c5-d40ff2e7eef8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.903055] env[65353]: INFO networking_nsxv3.common.synchronization [None req-6e474417-cd5b-4011-a7c2-15eefa75f0a0 None None] Enqueued Resource ID: 06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338 with Priority: HIGHEST for action port [ 645.904714] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338 with Priority: HIGHEST for action port [ 645.904714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.904714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.905711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.905711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.905711] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.098629] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: SUCCESS [ 646.098629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.117410] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.117410] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.117410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.117793] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 with status ACTIVE [ 646.118442] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.118442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.118442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.118442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.118686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.118686] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.118825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.118825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.118965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.119231] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.119476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.119565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.119806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.119862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.120034] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8135b80e-fa43-4b09-a5c5-d40ff2e7eef8 is going to be updated. [ 646.142602] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.142861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.142861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.143115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.143245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.143407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8135b80e-fa43-4b09-a5c5-d40ff2e7eef8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.411456] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338 [ 646.411456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.411456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.411456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.411456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.411456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.411456] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338 already deleted. [ 646.411456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b1cf9e-9f69-4ac6-98cb-a06c2cbe8338" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.618331] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.874981] env[65353]: INFO networking_nsxv3.common.synchronization [req-db001ff8-b9a1-4204-b57b-fa0165f0b341 req-cc0c61a6-f758-41e5-8ea6-7c1dc16a4356 tempest-ServerMetadataTestJSON-89635030 tempest-ServerMetadataTestJSON-89635030-project-member] Enqueued Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 646.875529] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 646.875831] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.875967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.877578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.877893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.878084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.878878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.878965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.879151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.879237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.879777] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.121434] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.121761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.121761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.121871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.121959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.125232] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 is going to be created. [ 647.153145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.155156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.155156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.155156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.155156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.167021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: UNINITIALIZED for 2s [ 647.384845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.385058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.385107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.385306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.385393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.385577] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.385704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.385763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.385868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.385939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.386044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 already deleted. [ 647.386115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.587248] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.587432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-235" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.587550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-235" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.587875] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-235" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.588140] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.588288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.588397] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.588609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.588744] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.588939] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.589054] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.589195] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.589306] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.589358] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.589465] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.589591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.608740] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.608901] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.609041] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.609214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-235" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.609528] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-61139375-d7d8-4f37-b513-480455bf6776 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.609683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.609794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.610104] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.610238] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61139375-d7d8-4f37-b513-480455bf6776',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.741679] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0531078a-b369-445f-99da-e6dadf72474d None None] Enqueued Resource ID: 67490040-8320-449c-9728-2a38f326be5d with Priority: HIGHEST for action port [ 647.742233] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67490040-8320-449c-9728-2a38f326be5d with Priority: HIGHEST for action port [ 647.742570] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-67490040-8320-449c-9728-2a38f326be5d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.742690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67490040-8320-449c-9728-2a38f326be5d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.742752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67490040-8320-449c-9728-2a38f326be5d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.743008] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67490040-8320-449c-9728-2a38f326be5d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.743146] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67490040-8320-449c-9728-2a38f326be5d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.803315] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a1af8824-937a-433c-ab6a-a2c4cae4e9ca None None] Enqueued Resource ID: 686a3247-2107-46fe-ab48-e13853e7d0f8 with Priority: HIGHEST for action port [ 647.804101] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686a3247-2107-46fe-ab48-e13853e7d0f8 with Priority: HIGHEST for action port [ 647.804549] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-686a3247-2107-46fe-ab48-e13853e7d0f8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.804814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-686a3247-2107-46fe-ab48-e13853e7d0f8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.804972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-686a3247-2107-46fe-ab48-e13853e7d0f8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.805792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-686a3247-2107-46fe-ab48-e13853e7d0f8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.805792] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('686a3247-2107-46fe-ab48-e13853e7d0f8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.113074] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.113290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.113404] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.113751] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.113924] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.114091] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 61139375-d7d8-4f37-b513-480455bf6776 not found, creating... [ 648.114339] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.114483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.114586] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.114796] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.114956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.115265] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.116082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.116082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.116082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.116082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.116082] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 61139375-d7d8-4f37-b513-480455bf6776 is going to be created. [ 648.137350] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.137740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.137740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.138012] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.138239] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.138450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.249591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67490040-8320-449c-9728-2a38f326be5d [ 648.249835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.250035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.250122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.250392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.250538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.250660] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67490040-8320-449c-9728-2a38f326be5d already deleted. [ 648.250745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67490040-8320-449c-9728-2a38f326be5d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.307514] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 686a3247-2107-46fe-ab48-e13853e7d0f8 [ 648.307839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.307998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.308096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.308303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.308402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.308490] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:686a3247-2107-46fe-ab48-e13853e7d0f8 already deleted. [ 648.308586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-686a3247-2107-46fe-ab48-e13853e7d0f8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.484665] env[65353]: INFO networking_nsxv3.common.synchronization [req-80e91dc5-d359-457d-822e-d3bd4ab21c05 req-5b6bb722-1136-4b21-8705-a15fec9752c3 tempest-ServerExternalEventsTest-467245841 tempest-ServerExternalEventsTest-467245841-project-member] Enqueued Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 648.484665] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 648.488259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.488566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.489716] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.489716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.489716] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.882167] env[65353]: INFO networking_nsxv3.common.synchronization [req-db001ff8-b9a1-4204-b57b-fa0165f0b341 req-e0cb7aae-8fbd-46eb-a24b-7b0ac820bdfa service nova] Enqueued Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_rules [ 648.882340] env[65353]: INFO networking_nsxv3.common.synchronization [req-db001ff8-b9a1-4204-b57b-fa0165f0b341 req-e0cb7aae-8fbd-46eb-a24b-7b0ac820bdfa service nova] Enqueued Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 648.882468] env[65353]: INFO networking_nsxv3.common.synchronization [req-db001ff8-b9a1-4204-b57b-fa0165f0b341 req-e0cb7aae-8fbd-46eb-a24b-7b0ac820bdfa service nova] Enqueued Resource ID: 61139375-d7d8-4f37-b513-480455bf6776 with Priority: HIGHEST for action port [ 648.883264] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_rules [ 648.883264] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 648.883264] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61139375-d7d8-4f37-b513-480455bf6776 with Priority: HIGHEST for action port [ 648.883512] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.883629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.883691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.883949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.884158] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.885475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.885659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.885732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.885911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.886385] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.886488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.886558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.886721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.886853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.886898] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.888826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-61139375-d7d8-4f37-b513-480455bf6776 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.888927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.888966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.889138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.889211] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61139375-d7d8-4f37-b513-480455bf6776',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.911363] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.911363] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.911363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.912013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.912354] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.912576] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.915509] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.915509] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.915509] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.915509] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.915509] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.933769] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.933769] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.933769] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.933769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.933769] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-0fe44b10-0857-49ee-8766-2cc9f5ee968b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.933769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.934131] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.934834] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.934834] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe44b10-0857-49ee-8766-2cc9f5ee968b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.992096] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.992670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.992739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.995160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.995274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.995480] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.995635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.995635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.995822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.995878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.995958] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 already deleted. [ 648.996103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.179040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: SUCCESS [ 649.179040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.179430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.179468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.179670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.179792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.179858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.180032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.180119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.180209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.180299] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.386204] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.386385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.392561] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.393611] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61139375-d7d8-4f37-b513-480455bf6776 with status ACTIVE [ 649.394769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.394769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.394769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.395074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.395074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.395282] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.395638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.395638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.395638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.395747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.395783] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61139375-d7d8-4f37-b513-480455bf6776 is going to be updated. [ 649.420936] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.420936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.420936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.420936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.420936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.420936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61139375-d7d8-4f37-b513-480455bf6776" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.439659] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.439929] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.440096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.440396] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.440564] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.440739] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 0fe44b10-0857-49ee-8766-2cc9f5ee968b not found, creating... [ 649.441032] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.441196] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.441331] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.441742] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.441922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.442264] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.442548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.442690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.442959] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.446199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.446363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 0fe44b10-0857-49ee-8766-2cc9f5ee968b is going to be created. [ 649.472432] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.472432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.472432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.472432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.472432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.472659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.683998] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.898132] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.178448] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1131dcb1-600e-4dab-9f16-238c1b43cb08 None None] Enqueued Resource ID: 179634ee-3971-4839-adab-1ee970140cbb with Priority: HIGHEST for action port [ 650.178700] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179634ee-3971-4839-adab-1ee970140cbb with Priority: HIGHEST for action port [ 650.179645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-179634ee-3971-4839-adab-1ee970140cbb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.179645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179634ee-3971-4839-adab-1ee970140cbb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.179645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179634ee-3971-4839-adab-1ee970140cbb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.179960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179634ee-3971-4839-adab-1ee970140cbb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.179960] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179634ee-3971-4839-adab-1ee970140cbb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [req-80e91dc5-d359-457d-822e-d3bd4ab21c05 req-4eff9c46-d0a0-475c-a24e-6832a6399428 service nova] Enqueued Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_rules [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [req-80e91dc5-d359-457d-822e-d3bd4ab21c05 req-4eff9c46-d0a0-475c-a24e-6832a6399428 service nova] Enqueued Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [req-80e91dc5-d359-457d-822e-d3bd4ab21c05 req-4eff9c46-d0a0-475c-a24e-6832a6399428 service nova] Enqueued Resource ID: 0fe44b10-0857-49ee-8766-2cc9f5ee968b with Priority: HIGHEST for action port [ 650.187321] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e97e4458-7809-406b-8b2f-b7ee556500c1: rpc.has_security_group_logging(os_id): False [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_rules [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 650.187321] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe44b10-0857-49ee-8766-2cc9f5ee968b with Priority: HIGHEST for action port [ 650.187321] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.187574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.187574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.187924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.187924] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.188958] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.189328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.189328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.189420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.189575] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.189681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.189738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.189888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.190018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.190072] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.193190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe44b10-0857-49ee-8766-2cc9f5ee968b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.193325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.193472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.193633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.193709] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe44b10-0857-49ee-8766-2cc9f5ee968b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.212609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.212772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.212816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.213052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.213202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.213380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.213479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.213541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.213705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.213780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.213860] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 is going to be created. [ 650.276690] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.276841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.276911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.277253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.277991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.289175] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: IN_PROGRESS for 2s [ 650.400525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.400887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.400972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.401523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.401685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.401904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 is going to be created. [ 650.428271] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.428648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.429063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.429317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.429584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.440279] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: UNINITIALIZED for 2s [ 650.684858] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 179634ee-3971-4839-adab-1ee970140cbb [ 650.685100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.685277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.685426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.685504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.685591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685687] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:179634ee-3971-4839-adab-1ee970140cbb already deleted. [ 650.685776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179634ee-3971-4839-adab-1ee970140cbb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.695152] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.695270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.696025] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.696900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fe44b10-0857-49ee-8766-2cc9f5ee968b with status ACTIVE [ 650.696900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.696900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.696900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.697133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.697133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.697311] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.697424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.697488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.698624] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.698624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.698624] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fe44b10-0857-49ee-8766-2cc9f5ee968b is going to be updated. [ 650.724289] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.724789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.724789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.724882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.725724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.725724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe44b10-0857-49ee-8766-2cc9f5ee968b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.201632] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.704401] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.704401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.704786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.704786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.704786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.704921] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 is going to be created. [ 651.734039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.734039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.734039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.734039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.734039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.746142] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: UNINITIALIZED for 2s [ 652.302226] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: SUCCESS [ 652.302553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.451090] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: SUCCESS [ 652.451303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.451473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.451702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.452667] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.452823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.452893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.453091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.453179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.453323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.453382] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.956040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.956232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.956232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.956470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.956629] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.956739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.956804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.956956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.957056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.957151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.957297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.957391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.957450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.957595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.957738] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.957828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.957876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.958019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.958098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.958180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.958267] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.462116] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a50e19b0-6d35-4446-a201-3a0ffc40db91: rpc.has_security_group_logging(os_id): False [ 653.482661] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.483545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.483724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.483921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.484031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.484281] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.484393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.484449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.484608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.484676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.484859] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.485102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.485782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.485782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.485782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.485782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.485782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.486234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.487638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.487638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.487638] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 is going to be created. [ 653.553512] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.553726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.553775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.554069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.554291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.568437] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: IN_PROGRESS for 2s [ 653.758318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: UNINITIALIZED for 4s [ 654.775701] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3f90c07e-1037-4e8a-b745-10572104f33c None None] Enqueued Resource ID: ddc532f4-9bdb-4910-9fe6-c2f882986654 with Priority: HIGHEST for action port [ 654.776295] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc532f4-9bdb-4910-9fe6-c2f882986654 with Priority: HIGHEST for action port [ 654.776638] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc532f4-9bdb-4910-9fe6-c2f882986654 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.776785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc532f4-9bdb-4910-9fe6-c2f882986654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.776847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc532f4-9bdb-4910-9fe6-c2f882986654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.777602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc532f4-9bdb-4910-9fe6-c2f882986654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.777755] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc532f4-9bdb-4910-9fe6-c2f882986654',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.988917] env[65353]: INFO networking_nsxv3.common.synchronization [req-7bce31b2-7b0a-4aec-951e-88335397be19 req-65b74530-74d3-4302-8f05-6244c8ff051a tempest-ListImageFiltersTestJSON-1125268538 tempest-ListImageFiltersTestJSON-1125268538-project-member] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 654.989814] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 654.989938] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.991250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.991421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.992121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.992359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.992544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.992611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.992821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.992937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.993108] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.285251] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddc532f4-9bdb-4910-9fe6-c2f882986654 [ 655.285581] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.285808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.285948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.286332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.286508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.286670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddc532f4-9bdb-4910-9fe6-c2f882986654 already deleted. [ 655.286807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc532f4-9bdb-4910-9fe6-c2f882986654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.495819] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.496175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.496267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.496574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.496766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.497106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.497243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.497311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.497529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.497767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.497767] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 already deleted. [ 655.499284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.582323] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: SUCCESS [ 655.583106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.772931] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: SUCCESS [ 655.773501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.773501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.773926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.773926] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.774044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.774081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.774549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.774549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.774549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.774549] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.778881] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.779247] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.779247] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.779435] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.779794] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.779977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.780319] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.780510] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.780648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.780844] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.781073] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.781073] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.781179] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.781823] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.781823] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.781823] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.801418] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.801692] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.801849] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.802045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.802359] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-65067e03-784c-4e28-a6e7-df6659e4847c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.802628] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.802763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.803130] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.803278] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65067e03-784c-4e28-a6e7-df6659e4847c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.977348] env[65353]: INFO networking_nsxv3.common.synchronization [req-cc405f5a-af9d-42fd-9b0d-12e0e29a0cb6 req-e0919580-dc6e-4787-a614-921dccf8d0c1 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 655.978703] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 655.979165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.979311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.979455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.980238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.980594] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.980779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.980915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.981314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.981462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.981913] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.278110] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.278110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.278110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.278110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.279107] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.279442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.279740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.280272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.281895] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.281895] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.281895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.282666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.282917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.283125] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.305619] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.305619] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.305846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.305963] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.306116] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.307038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 65067e03-784c-4e28-a6e7-df6659e4847c not found, creating... [ 656.307038] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.307038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.307038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.307038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.307312] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.307364] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.307545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.307668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.307899] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.308105] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.308262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 65067e03-784c-4e28-a6e7-df6659e4847c is going to be created. [ 656.335811] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.335811] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.336244] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.336244] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.336447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.336676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.486361] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.786248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45dfa09f-d33f-4e30-90a3-f513b6ee3d71: rpc.has_security_group_logging(os_id): False [ 656.849263] env[65353]: INFO networking_nsxv3.common.synchronization [None req-825ddf19-c082-4e0b-9b35-c0eb6c51f3f8 None None] Enqueued Resource ID: 9cbeb562-9a93-498d-b435-469a4deaa27b with Priority: HIGHEST for action port [ 656.849871] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbeb562-9a93-498d-b435-469a4deaa27b with Priority: HIGHEST for action port [ 656.850281] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbeb562-9a93-498d-b435-469a4deaa27b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.850405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbeb562-9a93-498d-b435-469a4deaa27b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.850468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbeb562-9a93-498d-b435-469a4deaa27b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.850764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbeb562-9a93-498d-b435-469a4deaa27b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.850885] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbeb562-9a93-498d-b435-469a4deaa27b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.947195] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.947430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.947576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.948130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.948202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.948518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.948518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.948622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.948943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.948943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.949049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.949147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.949316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.949364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.949438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.949736] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.949736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.949838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.949908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.950032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.950159] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 is going to be created. [ 656.988859] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.053105] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.053934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.053934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.053934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.054123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.070652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: IN_PROGRESS for 2s [ 657.144853] env[65353]: INFO networking_nsxv3.common.synchronization [req-7bce31b2-7b0a-4aec-951e-88335397be19 req-801cc766-e3e8-46f0-82b0-7aeede150971 service nova] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_rules [ 657.145220] env[65353]: INFO networking_nsxv3.common.synchronization [req-7bce31b2-7b0a-4aec-951e-88335397be19 req-801cc766-e3e8-46f0-82b0-7aeede150971 service nova] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 657.146058] env[65353]: INFO networking_nsxv3.common.synchronization [req-7bce31b2-7b0a-4aec-951e-88335397be19 req-801cc766-e3e8-46f0-82b0-7aeede150971 service nova] Enqueued Resource ID: 65067e03-784c-4e28-a6e7-df6659e4847c with Priority: HIGHEST for action port [ 657.146383] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_rules [ 657.146513] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 657.146633] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65067e03-784c-4e28-a6e7-df6659e4847c with Priority: HIGHEST for action port [ 657.146954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.147102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.147165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.147487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.147627] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.149853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.149853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.149853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.150116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.150116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.150197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.150231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.150404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.150502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.150598] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.151603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-65067e03-784c-4e28-a6e7-df6659e4847c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.152389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.152456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.152692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.153176] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65067e03-784c-4e28-a6e7-df6659e4847c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.354015] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cbeb562-9a93-498d-b435-469a4deaa27b [ 657.354015] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.354239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.354239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.354392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.355344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.355966] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cbeb562-9a93-498d-b435-469a4deaa27b already deleted. [ 657.356087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbeb562-9a93-498d-b435-469a4deaa27b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.494354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.494543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.494618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.494863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.494955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.495105] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 657.531930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.531930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.531930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.531930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.531930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.545936] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 657.652499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.652499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.657040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65067e03-784c-4e28-a6e7-df6659e4847c with status ACTIVE [ 657.657040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.657040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.657040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.657040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.657040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.657389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.657389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.657389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.657503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.657584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.657777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.657886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.657959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.658100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.658172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.658271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65067e03-784c-4e28-a6e7-df6659e4847c is going to be updated. [ 657.663022] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.687022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.687232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.687289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.687525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.687683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.687870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65067e03-784c-4e28-a6e7-df6659e4847c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.164433] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.668951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.668951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.668951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.668951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.668951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.668951] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be created. [ 658.698101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.698449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.698733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.698879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.699141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.710748] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: UNINITIALIZED for 2s [ 659.040365] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d1b28137-37db-40e5-a62d-124fe6c4331b None None] Enqueued Resource ID: ed36b667-feea-4e3d-a360-591f5775b4a1 with Priority: HIGHEST for action port [ 659.042689] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed36b667-feea-4e3d-a360-591f5775b4a1 with Priority: HIGHEST for action port [ 659.043106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed36b667-feea-4e3d-a360-591f5775b4a1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.043295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed36b667-feea-4e3d-a360-591f5775b4a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.043363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed36b667-feea-4e3d-a360-591f5775b4a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.043579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed36b667-feea-4e3d-a360-591f5775b4a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.043678] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed36b667-feea-4e3d-a360-591f5775b4a1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.082248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: SUCCESS [ 659.085280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.548525] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed36b667-feea-4e3d-a360-591f5775b4a1 [ 659.549865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.550073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.550132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.550788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.550788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.550788] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed36b667-feea-4e3d-a360-591f5775b4a1 already deleted. [ 659.550788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed36b667-feea-4e3d-a360-591f5775b4a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.560799] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 659.561349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.670259] env[65353]: INFO networking_nsxv3.common.synchronization [req-f05596fa-74ba-4542-bcf0-4b8b459b176a req-1038d57c-4cd4-4fc5-9c9b-6dda9133f757 tempest-DeleteServersAdminTestJSON-257666599 tempest-DeleteServersAdminTestJSON-257666599-project-member] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 659.670259] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 659.670259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.670259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.670259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.670259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.670259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.670259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.670259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.672488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.672488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.672488] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.077716] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.077919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.078086] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.078323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.079547] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.079547] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.079547] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.079751] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.079977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.080576] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.080708] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.080814] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.080915] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.081032] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.081132] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.081253] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.107069] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.107230] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.107358] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.107531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.107955] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.108139] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.108250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.108550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.108681] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5072e59a-43e2-4f03-8bdd-71238d6aa6a1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.175058] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.175345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.175459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.175782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.175936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.176191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.176297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.176361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.176542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.176620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.176707] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be updated. [ 660.208523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.208769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.208861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.209190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.209450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.220430] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 660.612191] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.612191] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.612191] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.613041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.613041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.613849] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 not found, creating... [ 660.614345] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.614627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.615053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.617359] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.617359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.617359] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 is going to be created. [ 660.646980] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.646980] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.647283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.647870] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.647986] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.648848] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.728064] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 660.728595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.728896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.730315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.730757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.732831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.732831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.732831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.732831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.732831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.732831] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.816725] env[65353]: INFO networking_nsxv3.common.synchronization [req-74c1e19b-2d54-4cf7-8b81-c658206634e5 req-034f8bef-4cb2-492b-b52a-210b586b63ec tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 660.818891] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 660.818891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.818891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.818891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.818891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.819480] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.819690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.820473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.820473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.820473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.820473] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.988659] env[65353]: INFO networking_nsxv3.common.synchronization [None req-8d2db045-fd1c-44bc-a45d-9f7072b4921f None None] Enqueued Resource ID: 3d715e22-501d-45fe-b395-7cf1cb4af037 with Priority: HIGHEST for action port [ 660.989379] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d715e22-501d-45fe-b395-7cf1cb4af037 with Priority: HIGHEST for action port [ 660.989811] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d715e22-501d-45fe-b395-7cf1cb4af037 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.989963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d715e22-501d-45fe-b395-7cf1cb4af037" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.990095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d715e22-501d-45fe-b395-7cf1cb4af037" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.990418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d715e22-501d-45fe-b395-7cf1cb4af037" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.990544] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d715e22-501d-45fe-b395-7cf1cb4af037',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.236719] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.236890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.236983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.237473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.238367] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.238544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.238624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.238833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.238935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.239061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.239264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.239375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.239467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.239694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.239798] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.239901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.239976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.240161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.240238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.240337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.240438] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.323225] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.326403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.326403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.326403] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 661.361049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.361141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.362391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.362391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.362391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.365755] env[65353]: INFO networking_nsxv3.common.synchronization [req-12596264-028a-4a56-9079-3c919d4e810a req-a9943f41-8f4d-47a6-9427-4da1042a5ee6 tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 661.366244] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 661.366614] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.366742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.366809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.367087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.367255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.367356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.367417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.367570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.367654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.367769] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.373431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 661.402610] env[65353]: INFO networking_nsxv3.common.synchronization [req-f05596fa-74ba-4542-bcf0-4b8b459b176a req-a8c6244d-7f97-447d-b900-dc69aa34211d service nova] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_rules [ 661.402775] env[65353]: INFO networking_nsxv3.common.synchronization [req-f05596fa-74ba-4542-bcf0-4b8b459b176a req-a8c6244d-7f97-447d-b900-dc69aa34211d service nova] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 661.402873] env[65353]: INFO networking_nsxv3.common.synchronization [req-f05596fa-74ba-4542-bcf0-4b8b459b176a req-a8c6244d-7f97-447d-b900-dc69aa34211d service nova] Enqueued Resource ID: 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 with Priority: HIGHEST for action port [ 661.403410] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_rules [ 661.403551] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 661.403647] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 with Priority: HIGHEST for action port [ 661.405009] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.405155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.405221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.405502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.405502] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.406375] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.407031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.407031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.407031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.407031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.407202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.407251] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5072e59a-43e2-4f03-8bdd-71238d6aa6a1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.493333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d715e22-501d-45fe-b395-7cf1cb4af037 [ 661.493333] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.493333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.493333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.493333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.493333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.493333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d715e22-501d-45fe-b395-7cf1cb4af037 already deleted. [ 661.493333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d715e22-501d-45fe-b395-7cf1cb4af037" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.535637] env[65353]: INFO networking_nsxv3.common.synchronization [req-002cd89e-453c-4f91-99e1-acda374e24ea req-f5e3f4cf-eb58-4eae-ac09-d5b2b0c234ed tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: e2bcce78-c11d-45f2-bbe3-00cc0a9b621f with Priority: HIGHEST for action security_group_rules [ 661.536674] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bcce78-c11d-45f2-bbe3-00cc0a9b621f with Priority: HIGHEST for action security_group_rules [ 661.539205] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bcce78-c11d-45f2-bbe3-00cc0a9b621f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.539205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bcce78-c11d-45f2-bbe3-00cc0a9b621f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.539205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bcce78-c11d-45f2-bbe3-00cc0a9b621f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.539205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bcce78-c11d-45f2-bbe3-00cc0a9b621f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.539205] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bcce78-c11d-45f2-bbe3-00cc0a9b621f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.743265] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 752918e1-1064-471b-80a5-ab7d9c9b7427: rpc.has_security_group_logging(os_id): False [ 661.766040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.766239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.766376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.766577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.766900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.766900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.767058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.767058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.767155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.767236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.767462] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.767569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.767644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.767791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.767875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.768456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.768696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.768696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.768844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.768987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.769072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be created. [ 661.850476] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.851116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.851116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.851335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.851570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.867989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 661.870682] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.871159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.871319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.871428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.871804] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.872217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.872311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.872421] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 already deleted. [ 661.872530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.906697] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.906951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.907311] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.907507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.907811] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.907995] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.908421] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.908497] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.908651] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.908876] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.908982] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.909102] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.909206] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.909315] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.909413] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.909572] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.911254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.911389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.911850] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 with status ACTIVE [ 661.911850] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.911997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.912052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.912215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.912300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.912492] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.912568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.912610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.912799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.912879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.913290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.913290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.913290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.913481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.913692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.913692] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5072e59a-43e2-4f03-8bdd-71238d6aa6a1 is going to be updated. [ 661.939609] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.939609] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.939609] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.939609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.939884] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-96a9ba77-c1d6-4396-89a5-734be46e3771 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.940197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.940339] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.940755] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.940888] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9ba77-c1d6-4396-89a5-734be46e3771',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.967527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.967527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.967931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.967931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.968058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.968259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5072e59a-43e2-4f03-8bdd-71238d6aa6a1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.069980] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.070220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.070293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.070579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.070679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.070781] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bcce78-c11d-45f2-bbe3-00cc0a9b621f already deleted. [ 662.070864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bcce78-c11d-45f2-bbe3-00cc0a9b621f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.233229] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 662.233451] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 deletion is rescheduled due to dependency. [ 662.233578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.233751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.234020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.234260] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.234429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.234505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.234693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.234909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.235015] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.443764] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.444111] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.444273] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.445106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.445274] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.445726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 96a9ba77-c1d6-4396-89a5-734be46e3771 not found, creating... [ 662.445807] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.445915] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.446034] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.446284] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.446427] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.447802] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.447802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.447802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.447802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.447802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.447802] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 96a9ba77-c1d6-4396-89a5-734be46e3771 is going to be created. [ 662.470768] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.470768] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.470768] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.470768] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.470768] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.470768] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.737073] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.751820] env[65353]: INFO networking_nsxv3.common.synchronization [req-d2dd3f1c-6f4b-4a25-bbd8-93cc1fb18626 req-00e5d2ab-260d-4d95-958f-cdb7780840d1 tempest-ServerDiagnosticsNegativeTest-824436268 tempest-ServerDiagnosticsNegativeTest-824436268-project-member] Enqueued Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 662.752353] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGHEST for action security_group_members [ 662.752672] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.752794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.752861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.753361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.753361] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.753361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.753547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.753547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.753619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.753687] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.225619] env[65353]: INFO networking_nsxv3.common.synchronization [req-12596264-028a-4a56-9079-3c919d4e810a req-595a5a4a-8865-4ac2-9541-2c2c2cc1a392 service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 663.225795] env[65353]: INFO networking_nsxv3.common.synchronization [req-12596264-028a-4a56-9079-3c919d4e810a req-595a5a4a-8865-4ac2-9541-2c2c2cc1a392 service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 663.225949] env[65353]: INFO networking_nsxv3.common.synchronization [req-12596264-028a-4a56-9079-3c919d4e810a req-595a5a4a-8865-4ac2-9541-2c2c2cc1a392 service nova] Enqueued Resource ID: 96a9ba77-c1d6-4396-89a5-734be46e3771 with Priority: HIGHEST for action port [ 663.226159] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 663.226281] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 663.226396] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a9ba77-c1d6-4396-89a5-734be46e3771 with Priority: HIGHEST for action port [ 663.227387] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.227527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.227576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.227918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.227989] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.230408] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.230408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.230408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.230408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.230631] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.230631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.230631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.230914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.230914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.231283] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.232393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a9ba77-c1d6-4396-89a5-734be46e3771 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.232472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.232511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.232715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.232715] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9ba77-c1d6-4396-89a5-734be46e3771',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.239398] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.256535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.256697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.256765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.256999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.257170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.257417] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.257579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.257693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.258332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.258591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.261020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 is going to be updated. [ 663.295196] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.295373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.295414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.295615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.295756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.306174] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: IN_PROGRESS for 2s [ 663.388126] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 663.388467] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 deletion is rescheduled due to dependency. [ 663.389018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.734163] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.734347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.734526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.735431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96a9ba77-c1d6-4396-89a5-734be46e3771 with status ACTIVE [ 663.735623] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.735740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.735805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.736035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.736114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.736290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.736387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.736447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.736597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.736720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.736874] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.736965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.741102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.741384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.741482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.741617] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96a9ba77-c1d6-4396-89a5-734be46e3771 is going to be updated. [ 663.743194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.743291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.743361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.743532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.743611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.743700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be updated. [ 663.767553] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.767857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.767857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.768014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.768125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.768283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a9ba77-c1d6-4396-89a5-734be46e3771" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.780665] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.780665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.780665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.780948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.780948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.797969] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 663.867923] env[65353]: INFO networking_nsxv3.common.synchronization [req-6971ce1f-41e2-4953-bf55-b5d14244cdd7 req-d8693a48-0824-4e70-a46a-57321bd338d9 tempest-ListImageFiltersTestJSON-1125268538 tempest-ListImageFiltersTestJSON-1125268538-project-member] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 663.873983] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 663.873983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.873983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.873983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.874381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.874381] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.902059] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 663.902885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.243914] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.278328] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.278725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.278956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.279355] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.282922] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.282922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.282922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.282922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.282922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.282922] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.282922] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.282922] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.282922] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.282922] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.282922] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.282922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.304971] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.304971] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.304971] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.304971] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.304971] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-aa47826b-e453-4ce5-b594-3920ed580d63 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.304971] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.304971] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.304971] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.304971] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa47826b-e453-4ce5-b594-3920ed580d63',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.379515] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.748680] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.748969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.749295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.749489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.749686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.749866] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be created. [ 664.779018] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.779621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.779621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.779903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.790700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: UNINITIALIZED for 2s [ 664.807111] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.807404] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.807497] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.807698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.807864] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.808023] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port aa47826b-e453-4ce5-b594-3920ed580d63 not found, creating... [ 664.808277] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.808442] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.808530] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.808749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.808879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.809162] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.809306] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.809415] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.809966] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.810204] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.810380] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: aa47826b-e453-4ce5-b594-3920ed580d63 is going to be created. [ 664.833063] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.833313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.833466] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.833701] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.834049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.834295] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.881362] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.327230] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 in Status: SUCCESS [ 665.327530] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 deletion is rescheduled due to dependency. [ 665.327530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.386201] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.386201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.386201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.386201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.386201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.386201] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 665.424673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.427035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.427035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.427035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.427035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.438972] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 665.578308] env[65353]: INFO networking_nsxv3.common.synchronization [req-6971ce1f-41e2-4953-bf55-b5d14244cdd7 req-3adcb244-6599-413f-a1be-964b244b385e service nova] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_rules [ 665.578308] env[65353]: INFO networking_nsxv3.common.synchronization [req-6971ce1f-41e2-4953-bf55-b5d14244cdd7 req-3adcb244-6599-413f-a1be-964b244b385e service nova] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 665.578308] env[65353]: INFO networking_nsxv3.common.synchronization [req-6971ce1f-41e2-4953-bf55-b5d14244cdd7 req-3adcb244-6599-413f-a1be-964b244b385e service nova] Enqueued Resource ID: aa47826b-e453-4ce5-b594-3920ed580d63 with Priority: HIGHEST for action port [ 665.578308] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_rules [ 665.578308] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 665.578955] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa47826b-e453-4ce5-b594-3920ed580d63 with Priority: HIGHEST for action port [ 665.579401] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.579718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.579937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.582235] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.582235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.582235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa47826b-e453-4ce5-b594-3920ed580d63 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.582235] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa47826b-e453-4ce5-b594-3920ed580d63',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.810208] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 665.810452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.810579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.810793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.811016] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.811153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.811214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.811368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.811452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812042] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.017028] env[65353]: INFO networking_nsxv3.common.synchronization [req-0e638b26-e4c6-4f1a-bb33-61308394d202 req-9ce0e613-7d64-47bd-81ca-901948330c61 tempest-ServerDiagnosticsTest-669480676 tempest-ServerDiagnosticsTest-669480676-project-member] Enqueued Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 666.018263] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGHEST for action security_group_members [ 666.018263] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.018263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.018263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.018500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.018546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.018862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.018862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.018996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.019104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.019200] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.085942] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.086230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.086445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa47826b-e453-4ce5-b594-3920ed580d63 with status ACTIVE [ 666.086642] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.086744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.086812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.087130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.087646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.087986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.088196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.088324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.088686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.089182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.089182] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.089182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.089182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.089738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.089738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.089738] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa47826b-e453-4ce5-b594-3920ed580d63 is going to be updated. [ 666.131038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.131212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.131333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.131476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.131636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.131804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa47826b-e453-4ce5-b594-3920ed580d63" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.313476] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.313604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.313604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.313805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.313987] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.314135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.314192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.314476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.314476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.314476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.314681] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.314752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.314752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.314902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.315041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.315133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.315187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.315316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.315383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.315483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.315566] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.418882] env[65353]: INFO networking_nsxv3.common.synchronization [req-1a798261-7018-4bfb-9992-ae73d6d3caa2 req-286f2c2a-3de7-4af0-96e6-b3823eddadd5 tempest-VolumesAdminNegativeTest-448169051 tempest-VolumesAdminNegativeTest-448169051-project-member] Enqueued Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 666.419518] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGHEST for action security_group_members [ 666.420489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.424111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.424267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.424585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.424835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.425042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.427526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.427526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.427526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.427526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.522909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.523769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.523769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.527140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.527368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.527700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.527996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.527996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.528225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.529030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.529030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e is going to be updated. [ 666.573952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.575017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.575017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.575017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.575017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.584956] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: IN_PROGRESS for 2s [ 666.803027] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.803027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.803027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.803027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.821646] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462: rpc.has_security_group_logging(os_id): False [ 666.882921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.882921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.882921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.882921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.883365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.883365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.883611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.883693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.884082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.884226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.884309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.884515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.884617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.884729] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be updated. [ 666.929220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.931023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.931023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.931023] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b is going to be updated. [ 666.972200] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.972449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.972449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.972878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.972878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.975025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.975204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.975300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.975415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.975553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.990544] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: IN_PROGRESS for 2s [ 666.999422] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 667.308084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.308084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.308084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.308380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.308380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.308525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.308560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.308644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.308792] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.308913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.309083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.309220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.309309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.309368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.309508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.309685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.309799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.309890] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.454211] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.455550] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.455550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.455904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.455904] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.474248] env[65353]: INFO networking_nsxv3.common.synchronization [req-929df1c1-5fef-4c89-8f23-85b93c42e167 req-c94d0101-51b9-4539-a513-d47fcd96cd7e tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 11385940-4785-4bb4-9076-8af9804de418 with Priority: HIGHEST for action security_group_rules [ 667.475437] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11385940-4785-4bb4-9076-8af9804de418 with Priority: HIGHEST for action security_group_rules [ 667.475437] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11385940-4785-4bb4-9076-8af9804de418 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.475437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11385940-4785-4bb4-9076-8af9804de418" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.475437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11385940-4785-4bb4-9076-8af9804de418" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.475768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11385940-4785-4bb4-9076-8af9804de418" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.475768] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11385940-4785-4bb4-9076-8af9804de418',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.816481] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cadcc6df-baac-43fd-bf48-5485c0b69d95: rpc.has_security_group_logging(os_id): False [ 667.838790] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.840071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.844248] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.844248] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.844248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.845073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.845293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.845599] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.848596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.848596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.848596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.848596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.848596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be created. [ 667.958824] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.993212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.993366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.993433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.993734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.994110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.044336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.045069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.045069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.045069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.045069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.045069] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11385940-4785-4bb4-9076-8af9804de418 already deleted. [ 668.045069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11385940-4785-4bb4-9076-8af9804de418" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.052255] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 668.463209] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.598046] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e in Status: SUCCESS [ 668.598262] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e deletion is rescheduled due to dependency. [ 668.598390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.849937] env[65353]: INFO networking_nsxv3.common.synchronization [req-658b8633-ac85-47bb-876b-a1db30cdb629 req-817ac5fa-d98d-4676-90e7-9615e62e7c22 tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 668.850818] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 668.851363] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.851633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.851772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.852148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.852442] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.852652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.852776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.853071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.853222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.853671] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.966468] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.966468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.966468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.966764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.966764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.966976] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 669.014241] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364b11fe-318c-46b4-aed3-75bf7424303b in Status: SUCCESS [ 669.014528] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b deletion is rescheduled due to dependency. [ 669.014705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.016118] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.016118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.016118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.016346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.016496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.029810] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 669.036975] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 669.037299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.358267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.358267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.358267] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 already deleted. [ 669.358267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.402163] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.402396] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.402396] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.402757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.403251] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.403442] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.403555] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.403779] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.403918] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.404196] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.404311] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.404413] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.404515] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.404616] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.404722] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.404917] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.430277] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.430467] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.430626] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.430822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.431188] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-a64c3d4e-3365-44fe-95a3-47a8d31f7800 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.431395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.431528] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.431944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.432169] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a64c3d4e-3365-44fe-95a3-47a8d31f7800',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.936984] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.937340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.939804] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port a64c3d4e-3365-44fe-95a3-47a8d31f7800 not found, creating... [ 669.939804] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.939804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.939804] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.940327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.940327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.940327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.940327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.940327] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: a64c3d4e-3365-44fe-95a3-47a8d31f7800 is going to be created. [ 669.972184] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.972422] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.972654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.972873] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.973125] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.973353] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.065952] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 670.066418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.709136] env[65353]: INFO networking_nsxv3.common.synchronization [req-658b8633-ac85-47bb-876b-a1db30cdb629 req-709a2f47-a24b-4e6c-ad93-f1f6d36192a8 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 670.709426] env[65353]: INFO networking_nsxv3.common.synchronization [req-658b8633-ac85-47bb-876b-a1db30cdb629 req-709a2f47-a24b-4e6c-ad93-f1f6d36192a8 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 670.709590] env[65353]: INFO networking_nsxv3.common.synchronization [req-658b8633-ac85-47bb-876b-a1db30cdb629 req-709a2f47-a24b-4e6c-ad93-f1f6d36192a8 service nova] Enqueued Resource ID: a64c3d4e-3365-44fe-95a3-47a8d31f7800 with Priority: HIGHEST for action port [ 670.710717] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 670.710876] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 670.710949] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64c3d4e-3365-44fe-95a3-47a8d31f7800 with Priority: HIGHEST for action port [ 670.711299] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.711376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.711444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.711821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.711913] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.713573] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.713573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.713573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.713573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.713847] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.713847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.713953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.714167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.714285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.714410] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.717752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a64c3d4e-3365-44fe-95a3-47a8d31f7800 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.717752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.717752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.717752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.717752] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a64c3d4e-3365-44fe-95a3-47a8d31f7800',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.043029] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.043029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.043029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.043029] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.217579] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.217885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.217961] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.220182] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a64c3d4e-3365-44fe-95a3-47a8d31f7800 with status ACTIVE [ 671.220182] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.220182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.220182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.220804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.220909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.221256] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.222195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.222195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.222195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.223056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.223056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.223056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.223056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.223412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.223631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.223996] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a64c3d4e-3365-44fe-95a3-47a8d31f7800 is going to be updated. [ 671.258391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.258391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.258391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.258391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.258391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.258391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a64c3d4e-3365-44fe-95a3-47a8d31f7800" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.478623] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2befaa66-11de-4995-8d7c-d9cfb35d6c24 None None] Enqueued Resource ID: e5906989-7d99-4737-ba78-0d69d7ca3654 with Priority: HIGHEST for action port [ 671.481173] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5906989-7d99-4737-ba78-0d69d7ca3654 with Priority: HIGHEST for action port [ 671.481173] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5906989-7d99-4737-ba78-0d69d7ca3654 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.481173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5906989-7d99-4737-ba78-0d69d7ca3654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.481173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5906989-7d99-4737-ba78-0d69d7ca3654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.481173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5906989-7d99-4737-ba78-0d69d7ca3654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.481173] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5906989-7d99-4737-ba78-0d69d7ca3654',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.546580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.548125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.548367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.548664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.548965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.549138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.549236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.549381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.549496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.549677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.549891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.550116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.550116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.550283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.550445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.550548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.550605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.550819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.550884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.550972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.551409] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.631980] env[65353]: INFO networking_nsxv3.common.synchronization [req-e0f62bc9-792e-4d25-ac5b-166b7eadc928 req-882f46cc-7829-4eed-8941-17b2f6bc45c9 tempest-FloatingIPsAssociationTestJSON-1151398823 tempest-FloatingIPsAssociationTestJSON-1151398823-project-member] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 671.631980] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 671.632794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.633035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.633154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.633650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.633751] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.633892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.633999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.634245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.634377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.634526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.726786] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.985581] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5906989-7d99-4737-ba78-0d69d7ca3654 [ 671.985581] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.985581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.986075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.986075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.986150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.986187] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5906989-7d99-4737-ba78-0d69d7ca3654 already deleted. [ 671.986910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5906989-7d99-4737-ba78-0d69d7ca3654" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.032146] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.032502] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.032649] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.032999] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.033320] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.033557] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.033710] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.033963] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.034123] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.034332] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.034624] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.034624] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.034624] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.034732] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.034812] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.034936] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.054628] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 752918e1-1064-471b-80a5-ab7d9c9b7427: rpc.has_security_group_logging(os_id): False [ 672.064299] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.064299] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.064299] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.064299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-356" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.064299] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-135c9bcc-a069-4169-9973-a9db2c6af6da taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.064299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.064743] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.064782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.064952] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('135c9bcc-a069-4169-9973-a9db2c6af6da',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.079565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.079803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.079878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.080323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.080323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.080510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.080510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.080657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.080657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.080736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.081240] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.081240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.081240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.081487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.081487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.081775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.081775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.081910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.081946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.082204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.082204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 672.137715] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.191177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.191862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.191862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.191862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.192042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.212857] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 672.229831] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.230063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.230159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.230414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.230541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.230666] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be created. [ 672.291146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.291146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.291146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.291146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.291146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.301114] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: UNINITIALIZED for 2s [ 672.572026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 135c9bcc-a069-4169-9973-a9db2c6af6da not found, creating... [ 672.572026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.572026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572598] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572598] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572598] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.572598] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.572817] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 135c9bcc-a069-4169-9973-a9db2c6af6da is going to be created. [ 672.599812] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.600011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.600011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.600410] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.600817] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.602076] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.641011] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.143800] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.144169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.144169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.144639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.144639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.144639] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be updated. [ 673.178721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.179012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.179012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.179168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.179975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.196370] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 673.432529] env[65353]: INFO networking_nsxv3.common.synchronization [req-e0f62bc9-792e-4d25-ac5b-166b7eadc928 req-98fe81cc-15df-42c2-b846-3222622939a5 service nova] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_rules [ 673.432529] env[65353]: INFO networking_nsxv3.common.synchronization [req-e0f62bc9-792e-4d25-ac5b-166b7eadc928 req-98fe81cc-15df-42c2-b846-3222622939a5 service nova] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 673.432529] env[65353]: INFO networking_nsxv3.common.synchronization [req-e0f62bc9-792e-4d25-ac5b-166b7eadc928 req-98fe81cc-15df-42c2-b846-3222622939a5 service nova] Enqueued Resource ID: 135c9bcc-a069-4169-9973-a9db2c6af6da with Priority: HIGHEST for action port [ 673.436880] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_rules [ 673.436880] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 673.436880] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 135c9bcc-a069-4169-9973-a9db2c6af6da with Priority: HIGHEST for action port [ 673.436880] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.438083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.438083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.438083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.438083] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.438519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.438615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.438849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-135c9bcc-a069-4169-9973-a9db2c6af6da taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.440106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.440106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.440106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.440106] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('135c9bcc-a069-4169-9973-a9db2c6af6da',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.942171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.942345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.942670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 135c9bcc-a069-4169-9973-a9db2c6af6da with status ACTIVE [ 673.942911] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.943071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.943226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.943450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.943604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.943893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.944617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.944617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.944617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.944617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.944932] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.944932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.944932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.945595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.945595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.945595] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 135c9bcc-a069-4169-9973-a9db2c6af6da is going to be updated. [ 673.968342] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.968525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.971110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.971110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.971110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.971110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-135c9bcc-a069-4169-9973-a9db2c6af6da" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.233256] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 674.233256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.315413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 674.315413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.315413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.315413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.315810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.315810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.315915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.318323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.318865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.318865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.318865] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.352845] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f021a4b2-9e48-431f-a31b-5d5ccf834825 None None] Enqueued Resource ID: 70db7a14-165d-44d7-923f-b0efe975ab71 with Priority: HIGHEST for action port [ 674.353086] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70db7a14-165d-44d7-923f-b0efe975ab71 with Priority: HIGHEST for action port [ 674.353897] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-70db7a14-165d-44d7-923f-b0efe975ab71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.354200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70db7a14-165d-44d7-923f-b0efe975ab71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.357662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70db7a14-165d-44d7-923f-b0efe975ab71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.357662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70db7a14-165d-44d7-923f-b0efe975ab71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.357662] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70db7a14-165d-44d7-923f-b0efe975ab71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.824715] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.824887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.824959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.825211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.826483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.826657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.826729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.826925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.827029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.827130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.827298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.827397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.827455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.827612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.828425] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829681] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.864815] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70db7a14-165d-44d7-923f-b0efe975ab71 [ 674.864815] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.864815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.864815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.864815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.864815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.864815] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70db7a14-165d-44d7-923f-b0efe975ab71 already deleted. [ 674.864815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70db7a14-165d-44d7-923f-b0efe975ab71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.096416] env[65353]: INFO networking_nsxv3.common.synchronization [req-3f336ff7-c5a4-4f05-9533-9df40ac46c7f req-afdc22fd-b9d2-4d94-ae0f-7aff285f23d4 tempest-ServerExternalEventsTest-467245841 tempest-ServerExternalEventsTest-467245841-project-member] Enqueued Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 675.096416] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGHEST for action security_group_members [ 675.096416] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.096782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.096880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.097138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.097550] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.097550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.097550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.097713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.097788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.097886] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.212906] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 675.214227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.214227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.214227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.214461] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.215194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.215194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.215194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.215520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.215699] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.332491] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2f635c3-4601-4155-b8e5-e2dab677e518: rpc.has_security_group_logging(os_id): False [ 675.353777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.357049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.357049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.357049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.357834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.357834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.357834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.357834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.357834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.357834] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be created. [ 675.434549] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.434907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.435809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.453461] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 675.604092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.604092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.604955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.604955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.604955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.605103] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.605345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.605456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.606354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.606354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.606354] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 is going to be updated. [ 675.651846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.652132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.652241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.655929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.655929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.671441] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: IN_PROGRESS for 2s [ 675.718419] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.866180] env[65353]: INFO networking_nsxv3.common.synchronization [req-f9d16493-e16f-4840-9f07-febb04a8e19f req-d4c04fc4-b482-412a-8586-193647b90fc4 tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 6396d74e-d69a-44fa-88b5-2112bfe837e7 with Priority: HIGHEST for action security_group_rules [ 675.866874] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6396d74e-d69a-44fa-88b5-2112bfe837e7 with Priority: HIGHEST for action security_group_rules [ 675.867310] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6396d74e-d69a-44fa-88b5-2112bfe837e7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.867493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6396d74e-d69a-44fa-88b5-2112bfe837e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.867567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6396d74e-d69a-44fa-88b5-2112bfe837e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.867882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6396d74e-d69a-44fa-88b5-2112bfe837e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.868048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6396d74e-d69a-44fa-88b5-2112bfe837e7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.921021] env[65353]: INFO networking_nsxv3.common.synchronization [req-2c2f83df-d8d1-4a26-8a29-eb6d15d42f37 req-f056d66e-b4d7-4e61-90c2-0ac417a8f43d tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 675.921021] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 675.921021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.921021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.921021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.921021] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.221587] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.351902] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.351902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.351902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.352748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.352748] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.352748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.352748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.353074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.353074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.353679] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.353679] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.353679] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.353679] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.353679] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.354943] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.354943] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.380543] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.380731] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.380863] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.381049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.381373] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-9743cd18-88d6-454d-a58d-226e4a9a02c8 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.381544] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.381654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.382069] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.382211] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9743cd18-88d6-454d-a58d-226e4a9a02c8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.393156] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.393156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.393156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.393156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.393156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.393156] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6396d74e-d69a-44fa-88b5-2112bfe837e7 already deleted. [ 676.393156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6396d74e-d69a-44fa-88b5-2112bfe837e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.423690] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.726746] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.726907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.726984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.727207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.727296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.727394] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be updated. [ 676.759940] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.760103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.760173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.760758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.761016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.772844] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 676.884534] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.885147] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.885335] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.885683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.885827] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.885981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 9743cd18-88d6-454d-a58d-226e4a9a02c8 not found, creating... [ 676.886299] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.886440] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.886551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.886776] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.886937] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.887247] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.887398] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.887503] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.887719] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.887849] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.887981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 9743cd18-88d6-454d-a58d-226e4a9a02c8 is going to be created. [ 676.914575] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.914825] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.914939] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.915575] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.915686] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.915912] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.930158] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.431628] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.431920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.432091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.432363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.432471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.432593] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 677.476848] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.477187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.477187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.477495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.477791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.479835] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 677.480176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.493783] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 677.646607] env[65353]: INFO networking_nsxv3.common.synchronization [req-2c2f83df-d8d1-4a26-8a29-eb6d15d42f37 req-49100002-1e37-4bb9-8d26-0da12ab9950a service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 677.646607] env[65353]: INFO networking_nsxv3.common.synchronization [req-2c2f83df-d8d1-4a26-8a29-eb6d15d42f37 req-49100002-1e37-4bb9-8d26-0da12ab9950a service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 677.646607] env[65353]: INFO networking_nsxv3.common.synchronization [req-2c2f83df-d8d1-4a26-8a29-eb6d15d42f37 req-49100002-1e37-4bb9-8d26-0da12ab9950a service nova] Enqueued Resource ID: 9743cd18-88d6-454d-a58d-226e4a9a02c8 with Priority: HIGHEST for action port [ 677.647339] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 677.647820] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 677.647820] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9743cd18-88d6-454d-a58d-226e4a9a02c8 with Priority: HIGHEST for action port [ 677.648304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.648448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.648510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.649447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.649447] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.649982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.649982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.650183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9743cd18-88d6-454d-a58d-226e4a9a02c8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.650257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.650257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.654025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.654025] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9743cd18-88d6-454d-a58d-226e4a9a02c8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.682485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 in Status: SUCCESS [ 677.682631] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 deletion is rescheduled due to dependency. [ 677.682764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.152799] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.152977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.156580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9743cd18-88d6-454d-a58d-226e4a9a02c8 with status ACTIVE [ 678.156797] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.156976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.157113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.157474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.157474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.157662] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.157998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.157998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.158220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.158220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.158391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.158460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.158511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.158660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.158737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.158820] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9743cd18-88d6-454d-a58d-226e4a9a02c8 is going to be updated. [ 678.187825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.187825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.188090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.188090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.188363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.188363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9743cd18-88d6-454d-a58d-226e4a9a02c8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.676592] env[65353]: INFO networking_nsxv3.common.synchronization [req-494406d2-87c1-4ab3-994b-75bafcff43a8 req-17655277-1c38-4dce-80fd-6ada55d7cb81 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 678.678944] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 678.680294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.680294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.680294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.680294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.680294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.680701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.680873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.681065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.681167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.681283] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.787386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 678.787386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.787612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.787933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.788202] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.788351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.788433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.788658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.788748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.788838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.788930] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.184495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.184495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.184670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.185029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.185029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.185260] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.185406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.185538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.185698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.185803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.185922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 already deleted. [ 679.186090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.188658] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.188907] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-764" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.189082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-764" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.189479] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-764" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.189850] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.190081] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.190234] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.190521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.190704] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.190975] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.192870] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.193068] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.193227] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.193968] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.194174] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.194370] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.216254] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.216489] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.216548] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.216759] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-764" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.217037] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.217201] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.217330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.217972] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.217972] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.295697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.296335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.296419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.296672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.296826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.296931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.296999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.297163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.297250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.297340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.297484] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.297577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.297629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.297771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.297921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.298018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.298071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.298209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.298284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.298361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.298451] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.503922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 679.504185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.504348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.504672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.504836] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.504952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.505038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.505196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.505279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.505372] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.719927] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.720418] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.720418] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.720563] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.720708] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.720859] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 not found, creating... [ 679.721140] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.721298] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.721408] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.721627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.721868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.722177] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.722330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.722439] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.722648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.722846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.722992] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 is going to be created. [ 679.750564] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.750820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.750900] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.751238] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.751807] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.751807] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.800580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27ce0226-fe63-4c32-b41f-c2e799ff5d0a: rpc.has_security_group_logging(os_id): False [ 679.819695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.820025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.820025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.820233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.820332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.820525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.820624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.820687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.820841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.820914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.821117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.821210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.821284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.821433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.821520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.821849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.821957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.822019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.822175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.822249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.822333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be updated. [ 679.954721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.954946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.955328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.955436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.955624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.976115] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 680.009291] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.512516] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.691846] env[65353]: INFO networking_nsxv3.common.synchronization [req-494406d2-87c1-4ab3-994b-75bafcff43a8 req-efc11b47-5bb1-47ac-b7c2-943e99c85c80 service nova] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 680.692412] env[65353]: INFO networking_nsxv3.common.synchronization [req-494406d2-87c1-4ab3-994b-75bafcff43a8 req-efc11b47-5bb1-47ac-b7c2-943e99c85c80 service nova] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 680.692412] env[65353]: INFO networking_nsxv3.common.synchronization [req-494406d2-87c1-4ab3-994b-75bafcff43a8 req-efc11b47-5bb1-47ac-b7c2-943e99c85c80 service nova] Enqueued Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 680.692803] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 680.692962] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 680.694017] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 680.694096] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.694229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.694289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.694670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.694756] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.697152] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.697152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.697152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.697152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.697152] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.697394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.697394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.697459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.697492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.697754] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.699939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.699939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.699939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.699939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.699939] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.015311] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.015311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.015311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.015645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.015645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.015705] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 681.062778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.063145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.063145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.063327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.063423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.076700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 681.198046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.198046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.202370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.204446] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with status ACTIVE [ 681.204667] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.204823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.204904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.205093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.205185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.205353] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.205448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.205506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.205655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.205736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.205915] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.205996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.206647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.206989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.207275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.207346] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 is going to be updated. [ 681.232386] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.232619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.232667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.233226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.233226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.233372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.710562] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.995332] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 681.995865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.213560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.213953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.213953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.213953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.214258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.214258] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be created. [ 682.245027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.245027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.245027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.245027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.245027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.254834] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: UNINITIALIZED for 2s [ 682.390886] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e1b0410c-18d7-4339-8719-520a77fc3732 None None] Enqueued Resource ID: 84bcd621-d7e0-4529-b807-0bdbbe3d6ab2 with Priority: HIGHEST for action port [ 682.391371] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84bcd621-d7e0-4529-b807-0bdbbe3d6ab2 with Priority: HIGHEST for action port [ 682.391678] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-84bcd621-d7e0-4529-b807-0bdbbe3d6ab2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.392430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84bcd621-d7e0-4529-b807-0bdbbe3d6ab2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.392584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84bcd621-d7e0-4529-b807-0bdbbe3d6ab2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.393017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84bcd621-d7e0-4529-b807-0bdbbe3d6ab2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.393932] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84bcd621-d7e0-4529-b807-0bdbbe3d6ab2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.897177] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84bcd621-d7e0-4529-b807-0bdbbe3d6ab2 [ 682.897689] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.897689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.897689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.897837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.898438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.898438] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84bcd621-d7e0-4529-b807-0bdbbe3d6ab2 already deleted. [ 682.898438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84bcd621-d7e0-4529-b807-0bdbbe3d6ab2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.096680] env[65353]: INFO networking_nsxv3.common.synchronization [None req-37e63769-a1af-4c37-86fe-b9c493288fd7 None None] Enqueued Resource ID: 23ed9f53-1b25-4139-aa5b-c4e16f5253fb with Priority: HIGHEST for action port [ 683.096680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 683.096680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.096680] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ed9f53-1b25-4139-aa5b-c4e16f5253fb with Priority: HIGHEST for action port [ 683.097175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.097175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.097545] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.097735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.097809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.097986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.098080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.098165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.098252] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.100717] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-23ed9f53-1b25-4139-aa5b-c4e16f5253fb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.100862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23ed9f53-1b25-4139-aa5b-c4e16f5253fb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.100933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23ed9f53-1b25-4139-aa5b-c4e16f5253fb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.101455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23ed9f53-1b25-4139-aa5b-c4e16f5253fb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.101561] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ed9f53-1b25-4139-aa5b-c4e16f5253fb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.602964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.602964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.604222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.604222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.604222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.604222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.604222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.604222] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.608072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23ed9f53-1b25-4139-aa5b-c4e16f5253fb [ 683.608072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.608072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.608072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.608072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.608072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.608072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23ed9f53-1b25-4139-aa5b-c4e16f5253fb already deleted. [ 683.608072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23ed9f53-1b25-4139-aa5b-c4e16f5253fb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.110778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cadcc6df-baac-43fd-bf48-5485c0b69d95: rpc.has_security_group_logging(os_id): False [ 684.132991] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.132991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.132991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.132991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.133231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.133355] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.133415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.133455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.133582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.133657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.133846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.134193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.134193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.134193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.134193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.134624] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.134624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.134624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.134778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.134778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.134838] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 684.183945] env[65353]: INFO networking_nsxv3.common.synchronization [req-e6688780-99c3-4ea8-8eb3-df664d94f9da req-3e769bea-7668-48db-8b74-c3f6b08648de tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 684.183945] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 684.185511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.185667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.185732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.185946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.186130] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.187045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.187045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.187045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.187045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.187045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.219452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.219621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.219682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.219858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.220011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.239162] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 684.266725] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 684.267015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.267225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.267472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.267693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.267843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.267938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.270922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.270922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.270922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.270922] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.689296] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.765832] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.766187] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.766294] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.766668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.767265] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.767265] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.767501] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.768094] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.768094] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.768094] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.768094] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.768454] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.768454] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.768454] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.768454] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.768662] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.773152] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.773353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.773353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.774095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.774095] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.774095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.774095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.774095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.774095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.774404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.774404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.774404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.774535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.774667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.774720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.774812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.774871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.775053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.775116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.775224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.775354] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.801180] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.801180] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.801297] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.801500] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.801891] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-974aae0e-b22a-41c3-afe5-8adcd35f03ab taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.802090] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.802207] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.802875] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.803377] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974aae0e-b22a-41c3-afe5-8adcd35f03ab',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.192159] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.277837] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3431123-e3cf-4858-b3b8-2bcd1acc45c7: rpc.has_security_group_logging(os_id): False [ 685.307956] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.307956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.307956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.307956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.307956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.308342] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.308342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.308429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.308662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.308826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.309069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.309209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.309301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.309481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.309651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.309973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.310132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.310255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.312106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.312352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.312547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be created. [ 685.315477] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.315477] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.315477] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.315949] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.317725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.317725] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 974aae0e-b22a-41c3-afe5-8adcd35f03ab not found, creating... [ 685.317725] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.317725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.318079] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.318657] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.318760] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.319890] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.320430] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.320430] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.320527] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.320591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.320732] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 974aae0e-b22a-41c3-afe5-8adcd35f03ab is going to be created. [ 685.349890] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.349890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.350263] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.352008] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.352008] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.352008] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.446252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.447200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.447200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.447200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.447200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.457735] env[65353]: INFO networking_nsxv3.common.synchronization [None req-75d22f1b-590c-4cba-bb5c-42704f933838 None None] Enqueued Resource ID: 928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec with Priority: HIGHEST for action port [ 685.459053] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec with Priority: HIGHEST for action port [ 685.459053] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.459053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.459053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.459053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.459053] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.532468] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 685.695023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.695712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.695712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.695712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.695712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.695712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 685.741228] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.741455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.741537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.741855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.742305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.756037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 685.961948] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec [ 685.961948] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.962186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.962186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962787] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec already deleted. [ 685.962942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-928b6032-5dfe-4d7d-b6e3-ac7ce1a6b9ec" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.118626] env[65353]: INFO networking_nsxv3.common.synchronization [req-e6688780-99c3-4ea8-8eb3-df664d94f9da req-d500e852-a03c-4e2e-a0ca-439cdd4ce526 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 686.118626] env[65353]: INFO networking_nsxv3.common.synchronization [req-e6688780-99c3-4ea8-8eb3-df664d94f9da req-d500e852-a03c-4e2e-a0ca-439cdd4ce526 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 686.118820] env[65353]: INFO networking_nsxv3.common.synchronization [req-e6688780-99c3-4ea8-8eb3-df664d94f9da req-d500e852-a03c-4e2e-a0ca-439cdd4ce526 service nova] Enqueued Resource ID: 974aae0e-b22a-41c3-afe5-8adcd35f03ab with Priority: HIGHEST for action port [ 686.119303] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 686.119436] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 686.119532] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974aae0e-b22a-41c3-afe5-8adcd35f03ab with Priority: HIGHEST for action port [ 686.120185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.120185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.120185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.124288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.124288] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.124288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.124288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.124288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-974aae0e-b22a-41c3-afe5-8adcd35f03ab taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.124288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.124288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.124288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.126072] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('974aae0e-b22a-41c3-afe5-8adcd35f03ab',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.260376] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 686.260440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.367170] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f8bc4b39-93af-4e58-80f9-c12ac605c964 None None] Enqueued Resource ID: c44c22e8-ec59-4268-acf7-66fd1f0d569a with Priority: HIGHEST for action port [ 686.368016] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c44c22e8-ec59-4268-acf7-66fd1f0d569a with Priority: HIGHEST for action port [ 686.369727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c44c22e8-ec59-4268-acf7-66fd1f0d569a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.370188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c44c22e8-ec59-4268-acf7-66fd1f0d569a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.371500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c44c22e8-ec59-4268-acf7-66fd1f0d569a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.371500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c44c22e8-ec59-4268-acf7-66fd1f0d569a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.371500] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c44c22e8-ec59-4268-acf7-66fd1f0d569a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.561502] env[65353]: INFO networking_nsxv3.common.synchronization [req-c88e7d8b-de4f-4aed-9a2d-27aa60c53db0 req-0d71b362-b734-4d95-84be-1792fed8dcde tempest-DeleteServersAdminTestJSON-257666599 tempest-DeleteServersAdminTestJSON-257666599-project-member] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 686.562806] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGHEST for action security_group_members [ 686.563478] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.564106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.564106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.564238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.564632] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.564632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.564632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.564842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.564913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.565026] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.628682] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.628682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.629028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 974aae0e-b22a-41c3-afe5-8adcd35f03ab with status ACTIVE [ 686.629276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.629388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.630092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.630092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.630092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.630294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.630294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.630398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.630633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.630689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.630957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.631934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.632040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.632343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.632385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.632509] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 974aae0e-b22a-41c3-afe5-8adcd35f03ab is going to be updated. [ 686.663494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.663494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.663494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.664043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.664204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.664262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-974aae0e-b22a-41c3-afe5-8adcd35f03ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.792568] env[65353]: INFO networking_nsxv3.common.synchronization [req-25c11ad4-2ad5-4f57-b853-7a9f906f282c req-bb36b6a9-1307-4fa4-ae82-60ac1bc85136 tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 7bde1147-7781-4fe2-b73a-a56ea79a81ab with Priority: HIGHEST for action security_group_rules [ 686.792901] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bde1147-7781-4fe2-b73a-a56ea79a81ab with Priority: HIGHEST for action security_group_rules [ 686.792943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bde1147-7781-4fe2-b73a-a56ea79a81ab taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.794336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bde1147-7781-4fe2-b73a-a56ea79a81ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.794336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bde1147-7781-4fe2-b73a-a56ea79a81ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.794336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bde1147-7781-4fe2-b73a-a56ea79a81ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.794336] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bde1147-7781-4fe2-b73a-a56ea79a81ab',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.879086] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c44c22e8-ec59-4268-acf7-66fd1f0d569a [ 686.879448] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.879637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.879811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.880109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.880241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.880367] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c44c22e8-ec59-4268-acf7-66fd1f0d569a already deleted. [ 686.880455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c44c22e8-ec59-4268-acf7-66fd1f0d569a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.068311] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.068477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.068586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.068775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.069096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.069096] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.069335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.069335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.069451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.069529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.069714] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be updated. [ 687.105722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.105938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.106015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.106211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.106362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.119636] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: IN_PROGRESS for 2s [ 687.331397] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.331732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.331899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.332219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.333262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.333262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bde1147-7781-4fe2-b73a-a56ea79a81ab already deleted. [ 687.333262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bde1147-7781-4fe2-b73a-a56ea79a81ab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.547148] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 687.547148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.768888] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 4s [ 687.802456] env[65353]: INFO networking_nsxv3.common.synchronization [req-06a95833-4ea9-4115-a376-d4608b486f25 req-329d83cd-1fea-4304-b58b-129d05b60a25 tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 687.803260] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 687.803617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.803752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.803816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.804047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.804215] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.804309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.804383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.804643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.804643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.805123] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.248587] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.249536] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.249536] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.249536] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.249536] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.249739] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.249739] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.249892] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.250036] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.250239] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.250368] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.250434] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.250596] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.250876] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.250876] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.250876] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.274605] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.274762] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.274892] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.275079] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.275386] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-ab3e4c1a-4083-4ceb-b86e-005da10e4229 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.275587] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.275716] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.276976] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.277148] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab3e4c1a-4083-4ceb-b86e-005da10e4229',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.307653] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.557217] env[65353]: INFO networking_nsxv3.common.synchronization [req-ac0fb647-9f72-4313-b32c-cf9980beffa4 req-c952419a-6d43-4a46-9717-2eef2695b6fe tempest-FloatingIPsAssociationNegativeTestJSON-719006263 tempest-FloatingIPsAssociationNegativeTestJSON-719006263-project-member] Enqueued Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 688.558048] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGHEST for action security_group_members [ 688.558546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.558666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.558781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.559131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.559587] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.559957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.559957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.560226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.560328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.560473] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.779958] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.780268] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.780501] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.780802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.780802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.780904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port ab3e4c1a-4083-4ceb-b86e-005da10e4229 not found, creating... [ 688.781976] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.782132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.782282] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.782513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.782647] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.782978] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.783166] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.783278] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.783484] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.783653] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.783742] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: ab3e4c1a-4083-4ceb-b86e-005da10e4229 is going to be created. [ 688.805817] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.806266] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.806374] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.806700] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.807758] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.807758] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.810886] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.063748] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.064434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.064434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.064434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.064434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.065460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.065460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.065460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.065460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.065460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.065460] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 101d7123-33df-4206-98ea-c31321fdee80 is going to be updated. [ 689.093663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.093794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.093901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.094219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.094397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.104274] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: IN_PROGRESS for 2s [ 689.130284] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 in Status: SUCCESS [ 689.130907] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 deletion is rescheduled due to dependency. [ 689.131113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.313170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.313324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.313740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.313740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.313740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.313856] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 689.348416] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.348569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.348623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.348848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.348975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.371267] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 689.567671] env[65353]: INFO networking_nsxv3.common.synchronization [req-06a95833-4ea9-4115-a376-d4608b486f25 req-39f42ce2-9556-4179-aa25-3c48c5e176c8 service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 689.567896] env[65353]: INFO networking_nsxv3.common.synchronization [req-06a95833-4ea9-4115-a376-d4608b486f25 req-39f42ce2-9556-4179-aa25-3c48c5e176c8 service nova] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 689.567975] env[65353]: INFO networking_nsxv3.common.synchronization [req-06a95833-4ea9-4115-a376-d4608b486f25 req-39f42ce2-9556-4179-aa25-3c48c5e176c8 service nova] Enqueued Resource ID: ab3e4c1a-4083-4ceb-b86e-005da10e4229 with Priority: HIGHEST for action port [ 689.569029] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_rules [ 689.569029] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 689.569029] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3e4c1a-4083-4ceb-b86e-005da10e4229 with Priority: HIGHEST for action port [ 689.569215] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.569351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.569401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.570023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.570023] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.571641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.571641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.571641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab3e4c1a-4083-4ceb-b86e-005da10e4229 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.571641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.571641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.571925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.571925] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab3e4c1a-4083-4ceb-b86e-005da10e4229',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.783160] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.787085] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.787085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.787085] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.075735] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.076074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.076624] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab3e4c1a-4083-4ceb-b86e-005da10e4229 with status ACTIVE [ 690.076624] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.076797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.076859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.077061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.077228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.077471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.077632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.077729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.078883] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.078883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.079311] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab3e4c1a-4083-4ceb-b86e-005da10e4229 is going to be updated. [ 690.111293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.111572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.111644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.112338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.112338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.112338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab3e4c1a-4083-4ceb-b86e-005da10e4229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.286759] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.788907] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.125058] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 101d7123-33df-4206-98ea-c31321fdee80 in Status: SUCCESS [ 691.125347] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 101d7123-33df-4206-98ea-c31321fdee80 deletion is rescheduled due to dependency. [ 691.125448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.291598] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.291789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.291888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.292168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.292264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.292368] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 691.326454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.326673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.326784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.328715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.328715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.339852] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 691.382278] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 691.382535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.382731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.383049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.383276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.383437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.383527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.383722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.383821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.383946] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.889177] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.389875] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.893483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.893483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.893483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.893483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.893483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.893483] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 692.958405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.958405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.958595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.958703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.958871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.975300] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 693.354680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 693.354926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.355129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.355405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.355637] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.355775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.355838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.356101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.356163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.356268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.356348] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.626639] env[65353]: INFO networking_nsxv3.common.synchronization [None req-876ada09-f074-4cae-a637-c47f3fa280eb None None] Enqueued Resource ID: f36573e9-08b6-4620-a554-48ff7e27d6a8 with Priority: HIGHEST for action port [ 693.627636] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f36573e9-08b6-4620-a554-48ff7e27d6a8 with Priority: HIGHEST for action port [ 693.628549] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f36573e9-08b6-4620-a554-48ff7e27d6a8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.628822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f36573e9-08b6-4620-a554-48ff7e27d6a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.628944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f36573e9-08b6-4620-a554-48ff7e27d6a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.629417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f36573e9-08b6-4620-a554-48ff7e27d6a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.629417] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f36573e9-08b6-4620-a554-48ff7e27d6a8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.862177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.862177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.862177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.862177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.862177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.862177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.862177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.863052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.863052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.863052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.863429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.863429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.863429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.863429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.863429] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.132665] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f36573e9-08b6-4620-a554-48ff7e27d6a8 [ 694.133403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.133696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.133827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.134163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.134316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.134432] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f36573e9-08b6-4620-a554-48ff7e27d6a8 already deleted. [ 694.134585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f36573e9-08b6-4620-a554-48ff7e27d6a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.370203] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2f635c3-4601-4155-b8e5-e2dab677e518: rpc.has_security_group_logging(os_id): False [ 694.395295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.396140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.396330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.396642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.396861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.397194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.397423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.397594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.397876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.398058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.398338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.398540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.398779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.399029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.399210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.399488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.400479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.400648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.400885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.401060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.401227] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 694.491670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.493412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.493747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.494085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.497722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.512979] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 694.694543] env[65353]: INFO networking_nsxv3.common.synchronization [None req-28a94334-1ebb-4968-93c7-2a32c0e0b42c None None] Enqueued Resource ID: 0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630 with Priority: HIGHEST for action port [ 694.697451] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630 with Priority: HIGHEST for action port [ 694.697451] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.697451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.697451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.697796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.697949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.988065] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 694.988336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.988532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.988795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.988966] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.989079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.989125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.989264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.989343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.989427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.989511] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.203034] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630 [ 695.203034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.203034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.203034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.203034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.203034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.203034] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630 already deleted. [ 695.203034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bfeaa68-3d9d-44a0-b2e5-f028b6dcb630" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.494927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.494927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.494927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.494927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.494927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.495606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.495606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.495606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.495606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.495606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.497274] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.999979] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cadcc6df-baac-43fd-bf48-5485c0b69d95: rpc.has_security_group_logging(os_id): False [ 696.024150] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.024150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.024405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.024805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.024805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.026130] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.026502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.026576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.026916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.026916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.027370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.028916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.029131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.030124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.030124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.030124] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.030810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.030810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.030810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.030810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.031072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 696.164032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.164190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.164372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.164746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.165022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.193057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 696.472894] env[65353]: INFO networking_nsxv3.common.synchronization [None req-df9ab4ee-0283-4ebe-9ea7-754a9725404e None None] Enqueued Resource ID: ef3ac2dc-716a-4f13-ac3a-1f5905108097 with Priority: HIGHEST for action port [ 696.473604] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef3ac2dc-716a-4f13-ac3a-1f5905108097 with Priority: HIGHEST for action port [ 696.473978] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef3ac2dc-716a-4f13-ac3a-1f5905108097 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.475104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef3ac2dc-716a-4f13-ac3a-1f5905108097" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.475104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef3ac2dc-716a-4f13-ac3a-1f5905108097" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.475809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef3ac2dc-716a-4f13-ac3a-1f5905108097" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.475809] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef3ac2dc-716a-4f13-ac3a-1f5905108097',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.531856] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 696.532136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.979405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef3ac2dc-716a-4f13-ac3a-1f5905108097 [ 696.979638] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.979785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.979870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.980162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.980262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.980363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef3ac2dc-716a-4f13-ac3a-1f5905108097 already deleted. [ 696.980449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef3ac2dc-716a-4f13-ac3a-1f5905108097" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.208449] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c7de0bb6-56b8-430a-b36b-9912e307dd9c None None] Enqueued Resource ID: 6cf05fe6-0a77-4086-8622-9244ac234ea8 with Priority: HIGHEST for action port [ 697.209399] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf05fe6-0a77-4086-8622-9244ac234ea8 with Priority: HIGHEST for action port [ 697.209501] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cf05fe6-0a77-4086-8622-9244ac234ea8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.209635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cf05fe6-0a77-4086-8622-9244ac234ea8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.209702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cf05fe6-0a77-4086-8622-9244ac234ea8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.209988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cf05fe6-0a77-4086-8622-9244ac234ea8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.210091] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cf05fe6-0a77-4086-8622-9244ac234ea8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.713428] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cf05fe6-0a77-4086-8622-9244ac234ea8 [ 697.713588] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.714060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.714060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.714160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.714364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.714751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cf05fe6-0a77-4086-8622-9244ac234ea8 already deleted. [ 697.714751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cf05fe6-0a77-4086-8622-9244ac234ea8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.214070] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 698.214750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.843383] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f7bc3219-5ba0-4866-abe2-5f19f28d7fbf None None] Enqueued Resource ID: f00a7f4c-0846-41e0-bea5-88167389491f with Priority: HIGHEST for action port [ 699.843683] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00a7f4c-0846-41e0-bea5-88167389491f with Priority: HIGHEST for action port [ 699.844559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f00a7f4c-0846-41e0-bea5-88167389491f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.844559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f00a7f4c-0846-41e0-bea5-88167389491f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.844559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f00a7f4c-0846-41e0-bea5-88167389491f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.844898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f00a7f4c-0846-41e0-bea5-88167389491f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.844898] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f00a7f4c-0846-41e0-bea5-88167389491f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.347010] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f00a7f4c-0846-41e0-bea5-88167389491f [ 700.347267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.347392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.347440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.347758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.348098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.348248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f00a7f4c-0846-41e0-bea5-88167389491f already deleted. [ 700.348372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f00a7f4c-0846-41e0-bea5-88167389491f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.676127] env[65353]: INFO networking_nsxv3.common.synchronization [None req-77801ca6-82d2-4662-a5f5-8fd0688373f6 None None] Enqueued Resource ID: ad68adda-5104-444e-b423-02e7d26144be with Priority: HIGHEST for action port [ 701.676766] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad68adda-5104-444e-b423-02e7d26144be with Priority: HIGHEST for action port [ 701.677904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad68adda-5104-444e-b423-02e7d26144be taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.679401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad68adda-5104-444e-b423-02e7d26144be" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.679401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad68adda-5104-444e-b423-02e7d26144be" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.679401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad68adda-5104-444e-b423-02e7d26144be" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.679401] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad68adda-5104-444e-b423-02e7d26144be',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.042045] env[65353]: INFO networking_nsxv3.common.synchronization [None req-235e8bbd-c507-4b5a-a9c3-9cd280a58015 None None] Enqueued Resource ID: ae224f9b-628a-4b8e-b993-d11d7bb23244 with Priority: HIGHEST for action port [ 702.042045] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae224f9b-628a-4b8e-b993-d11d7bb23244 with Priority: HIGHEST for action port [ 702.042290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae224f9b-628a-4b8e-b993-d11d7bb23244 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.042897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae224f9b-628a-4b8e-b993-d11d7bb23244" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.042897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae224f9b-628a-4b8e-b993-d11d7bb23244" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.042897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae224f9b-628a-4b8e-b993-d11d7bb23244" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.042897] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae224f9b-628a-4b8e-b993-d11d7bb23244',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.184407] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad68adda-5104-444e-b423-02e7d26144be [ 702.184563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.184679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.184743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.185016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.185119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.185222] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad68adda-5104-444e-b423-02e7d26144be already deleted. [ 702.185302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad68adda-5104-444e-b423-02e7d26144be" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.544883] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae224f9b-628a-4b8e-b993-d11d7bb23244 [ 702.546423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.546585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.546664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.546854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.546944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.547061] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae224f9b-628a-4b8e-b993-d11d7bb23244 already deleted. [ 702.547145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae224f9b-628a-4b8e-b993-d11d7bb23244" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.725679] env[65353]: INFO networking_nsxv3.common.synchronization [req-f14699ac-8806-43aa-ba2d-7b6931de557d req-333d10f1-5cc7-4e1f-970d-eb2caddb0b77 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 702.725679] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 702.725972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.726050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.727391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.727391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.727391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.727391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.727391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.727822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.727822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.727822] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.236057] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.236057] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.236057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea already deleted. [ 703.236057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.096572] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.096935] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.096935] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.097833] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.097833] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.098612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.098877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.099326] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.099604] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.100507] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.100507] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.100507] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.100507] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.100507] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.100738] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.100808] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.127685] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.127972] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.128216] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.128490] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.129204] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-6fa58613-23be-4b22-ae4e-093b77a308fd taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.129590] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.129692] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.130201] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.130339] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa58613-23be-4b22-ae4e-093b77a308fd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.433923] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b5b52715-1801-4ded-be0a-dce5dd47a7e3 None None] Enqueued Resource ID: ef529606-ba29-452a-a5a0-190d2fa2a225 with Priority: HIGHEST for action port [ 704.434929] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef529606-ba29-452a-a5a0-190d2fa2a225 with Priority: HIGHEST for action port [ 704.435382] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef529606-ba29-452a-a5a0-190d2fa2a225 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.435534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef529606-ba29-452a-a5a0-190d2fa2a225" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.435621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef529606-ba29-452a-a5a0-190d2fa2a225" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.436168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef529606-ba29-452a-a5a0-190d2fa2a225" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.436168] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef529606-ba29-452a-a5a0-190d2fa2a225',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.633396] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.633573] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.633573] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.633871] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.634059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.634237] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 6fa58613-23be-4b22-ae4e-093b77a308fd not found, creating... [ 704.634533] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.634695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.634850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.635048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.635194] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.635497] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.635661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.635780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.636013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.636185] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.636325] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 6fa58613-23be-4b22-ae4e-093b77a308fd is going to be created. [ 704.669099] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.669926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.669926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.669926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.670471] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.670770] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef529606-ba29-452a-a5a0-190d2fa2a225 [ 704.939291] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.939386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.939457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.939678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.939767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939865] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef529606-ba29-452a-a5a0-190d2fa2a225 already deleted. [ 704.939952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef529606-ba29-452a-a5a0-190d2fa2a225" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.202167] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e160d058-ab86-4e76-80ca-01fbad4796c8 None None] Enqueued Resource ID: 97ed5b53-3102-4035-b372-f6a54aed903f with Priority: HIGHEST for action port [ 705.202725] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97ed5b53-3102-4035-b372-f6a54aed903f with Priority: HIGHEST for action port [ 705.202989] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-97ed5b53-3102-4035-b372-f6a54aed903f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.203198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97ed5b53-3102-4035-b372-f6a54aed903f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.203198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97ed5b53-3102-4035-b372-f6a54aed903f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.203487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97ed5b53-3102-4035-b372-f6a54aed903f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.203574] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97ed5b53-3102-4035-b372-f6a54aed903f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.406439] env[65353]: INFO networking_nsxv3.common.synchronization [req-f14699ac-8806-43aa-ba2d-7b6931de557d req-a0882de4-3736-4f7e-9307-dce99aed6fa4 service nova] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 705.406611] env[65353]: INFO networking_nsxv3.common.synchronization [req-f14699ac-8806-43aa-ba2d-7b6931de557d req-a0882de4-3736-4f7e-9307-dce99aed6fa4 service nova] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 705.406739] env[65353]: INFO networking_nsxv3.common.synchronization [req-f14699ac-8806-43aa-ba2d-7b6931de557d req-a0882de4-3736-4f7e-9307-dce99aed6fa4 service nova] Enqueued Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 705.408028] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 705.408028] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 705.408028] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 705.408028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.408028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.408506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.408506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.408506] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.409316] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.409540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.409617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.409798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.410132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.410213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.410417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.411042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.411042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.411188] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.414399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa58613-23be-4b22-ae4e-093b77a308fd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.414516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.414580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.414755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.414831] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa58613-23be-4b22-ae4e-093b77a308fd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.709207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97ed5b53-3102-4035-b372-f6a54aed903f [ 705.709207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.709207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.709207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.709207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.709207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.709207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97ed5b53-3102-4035-b372-f6a54aed903f already deleted. [ 705.709207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97ed5b53-3102-4035-b372-f6a54aed903f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.915368] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.916558] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.916558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.923410] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa58613-23be-4b22-ae4e-093b77a308fd with status ACTIVE [ 705.923678] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.923848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.923916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.925019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.925019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.925360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.925772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.925845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.926032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.926103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.926557] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa58613-23be-4b22-ae4e-093b77a308fd is going to be updated. [ 705.956181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.956396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.957401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.957401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.957401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.957401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.071767] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-6c8ea6c6-519a-48d7-bba3-9ec947f5df23 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 706.071767] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 706.074366] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.074534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.074583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.074802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.074979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.075078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.075137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.075281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.075361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.075455] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.363688] env[65353]: INFO networking_nsxv3.common.synchronization [req-4a5921c5-1542-4461-874d-aed6d3559232 req-251e3350-3456-4142-a81a-7868d2bfa87e tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 706.364263] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 706.364622] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.364744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.364811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.365018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.367691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.367691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.367691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.367691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.367691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.367691] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.418474] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.582056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.582056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.582056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.582056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.582056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.585084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.585084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.585084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.585084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.585084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.585084] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 706.618706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.618706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.618706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.618706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.618706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.627382] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 706.834121] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.834450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.834450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.834687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.834947] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.837679] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.837838] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.838146] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.838288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.838516] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.838721] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.838835] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.838935] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.839102] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.839199] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.839331] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.860595] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.860864] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.861013] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.861190] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.861612] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-488ce965-4765-4b13-ade3-18c0c955129b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.861790] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.861904] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.862282] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.862417] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488ce965-4765-4b13-ade3-18c0c955129b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.870195] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.870352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.870479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.870626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.870715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.870912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.871016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.871071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.871221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.871296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.871381] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 706.908168] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.908168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.908303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.908453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.908599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.921216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.921429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.921538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.922174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.922335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.922478] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be created. [ 706.924985] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 706.954068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.954315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.954315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.954474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.954755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.976596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: UNINITIALIZED for 2s [ 707.333077] env[65353]: INFO networking_nsxv3.common.synchronization [None req-7b079562-32fe-4b26-be0a-d2bc665232a9 None None] Enqueued Resource ID: 1cf9263b-f038-4274-ab6d-2af5c3efd65f with Priority: HIGHEST for action port [ 707.333627] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf9263b-f038-4274-ab6d-2af5c3efd65f with Priority: HIGHEST for action port [ 707.333969] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cf9263b-f038-4274-ab6d-2af5c3efd65f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.334373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cf9263b-f038-4274-ab6d-2af5c3efd65f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.334373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cf9263b-f038-4274-ab6d-2af5c3efd65f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.334497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cf9263b-f038-4274-ab6d-2af5c3efd65f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.334557] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf9263b-f038-4274-ab6d-2af5c3efd65f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.364787] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.367974] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 488ce965-4765-4b13-ade3-18c0c955129b not found, creating... [ 707.367974] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.367974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.368326] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.368326] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.368472] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.368614] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.369780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.369780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369780] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 488ce965-4765-4b13-ade3-18c0c955129b is going to be created. [ 707.395845] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.395845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.395845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.395845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.395845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.395845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.839307] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cf9263b-f038-4274-ab6d-2af5c3efd65f [ 707.839307] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.839307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.839307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.839307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.839307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.839307] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cf9263b-f038-4274-ab6d-2af5c3efd65f already deleted. [ 707.839307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cf9263b-f038-4274-ab6d-2af5c3efd65f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.181204] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-7f3ab054-4f67-428e-9f01-be0c5f87ffc4 service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 708.181430] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-7f3ab054-4f67-428e-9f01-be0c5f87ffc4 service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 708.181598] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-7f3ab054-4f67-428e-9f01-be0c5f87ffc4 service nova] Enqueued Resource ID: 488ce965-4765-4b13-ade3-18c0c955129b with Priority: HIGHEST for action port [ 708.182253] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 708.182716] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 708.182716] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 488ce965-4765-4b13-ade3-18c0c955129b with Priority: HIGHEST for action port [ 708.182810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.182870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.183591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.184409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.184503] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.185465] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.185571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.185771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-488ce965-4765-4b13-ade3-18c0c955129b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.185908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.185952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.186122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.186196] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488ce965-4765-4b13-ade3-18c0c955129b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.395540] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-bd445b64-440e-48b0-859f-56652ce13ee8 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 708.397742] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 708.397742] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.397742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.420293] env[65353]: INFO networking_nsxv3.common.synchronization [None req-7b932d06-48d8-4427-85c3-9b9ea49d4718 None None] Enqueued Resource ID: 1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7 with Priority: HIGHEST for action port [ 708.420293] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7 with Priority: HIGHEST for action port [ 708.420293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.420293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.420683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.420683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.420683] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.594904] env[65353]: INFO networking_nsxv3.common.synchronization [req-903728c2-6e8c-4879-8423-2cca030e5e0b req-4d7299ee-6440-4523-a606-35906d2892ae tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 708.596506] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 708.596847] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.596986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.597053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.597903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.597993] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ad8996a-a41c-47de-bdc2-4012d45cd90b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.643904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 708.643904] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 deletion is rescheduled due to dependency. [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.643904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.643904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.643904] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.688651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.690041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.690041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 488ce965-4765-4b13-ade3-18c0c955129b with status ACTIVE [ 708.690041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.690041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.690041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.690041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.690041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.690404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.690404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.690404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.690527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.690527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.690668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.690761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.690819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.690958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.691045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.691276] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 488ce965-4765-4b13-ade3-18c0c955129b is going to be updated. [ 708.715673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.715836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.715881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.716110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.716254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.716414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-488ce965-4765-4b13-ade3-18c0c955129b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.859310] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.864085] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.864085] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.864884] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.865325] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.865659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.865909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.866389] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.866744] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.867263] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.867263] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.867640] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.867906] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.868104] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.868314] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.868576] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.894334] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.894334] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.894334] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.894483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-615" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.894889] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-ba8e1902-2906-4d91-bc11-fccc76070805 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.895195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.895856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.895856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.895993] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8e1902-2906-4d91-bc11-fccc76070805',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.922537] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7 [ 708.922777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.923796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.923796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.923796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.924048] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7 already deleted. [ 708.924048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aba80ab-0fa0-40f2-84df-bafa8e1dfdb7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.935052] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 708.935252] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 708.935371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.989111] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 708.989338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.989510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.989735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.990063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.990226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.990294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.990468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.990549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.990633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.990722] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.122073] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.122073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.122073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.122073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.122073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.122073] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b already deleted. [ 709.122073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.148140] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.350370] env[65353]: INFO networking_nsxv3.common.synchronization [None req-517e1b13-dbe0-435b-b575-a17bb3aaa96d None None] Enqueued Resource ID: 5b089574-2330-415e-a72c-024a64975c3e with Priority: HIGHEST for action port [ 709.350370] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b089574-2330-415e-a72c-024a64975c3e with Priority: HIGHEST for action port [ 709.350370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b089574-2330-415e-a72c-024a64975c3e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.350370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b089574-2330-415e-a72c-024a64975c3e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.350370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b089574-2330-415e-a72c-024a64975c3e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.350751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b089574-2330-415e-a72c-024a64975c3e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.350956] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b089574-2330-415e-a72c-024a64975c3e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.398291] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.398743] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.398743] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.398912] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.399123] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.399460] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port ba8e1902-2906-4d91-bc11-fccc76070805 not found, creating... [ 709.399637] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.400231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.400231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.400329] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.400392] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.400654] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.400876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.400950] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.401203] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.401345] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.401526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: ba8e1902-2906-4d91-bc11-fccc76070805 is going to be created. [ 709.422304] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.422520] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.422629] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.422895] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.423139] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.423363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.494038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.495039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.495039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.495039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.495039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.495317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.495317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.495521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.495521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.496773] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.496773] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.496773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.496773] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.652045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.854366] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b089574-2330-415e-a72c-024a64975c3e [ 709.854366] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.854366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.854366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.854366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.854366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.854366] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b089574-2330-415e-a72c-024a64975c3e already deleted. [ 709.854366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b089574-2330-415e-a72c-024a64975c3e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.000423] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 710.022746] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.022920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.023043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.023184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.023296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.023504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.023635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.023666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.023844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.023885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.024102] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.024225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.024265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.024402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.024453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.024649] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.024742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.024788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.024944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.025036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.025126] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be created. [ 710.090457] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.090712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.090712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.090900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.091099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.106750] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 710.155235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.156148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.156148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156148] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 710.212516] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.212647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.212725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.212942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.213137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.217771] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-62cfbc2b-1484-4eab-813c-ede7a45aa07b service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 710.217919] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-62cfbc2b-1484-4eab-813c-ede7a45aa07b service nova] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 710.218054] env[65353]: INFO networking_nsxv3.common.synchronization [req-0ca40e6f-8b81-4a33-889c-9dfdff7d930b req-62cfbc2b-1484-4eab-813c-ede7a45aa07b service nova] Enqueued Resource ID: ba8e1902-2906-4d91-bc11-fccc76070805 with Priority: HIGHEST for action port [ 710.219066] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_rules [ 710.219236] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 710.219360] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8e1902-2906-4d91-bc11-fccc76070805 with Priority: HIGHEST for action port [ 710.219662] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.219757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.219992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.220868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.221240] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8e1902-2906-4d91-bc11-fccc76070805 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.221333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.221385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.222135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.222135] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8e1902-2906-4d91-bc11-fccc76070805',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.228807] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 710.287670] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ab840e4e-3281-4a72-b0c5-f7c10a5e796b tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 710.291491] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 710.291491] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.291742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.291742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.292051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.292153] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.340595] env[65353]: INFO networking_nsxv3.common.synchronization [None req-63965d90-6fa0-4c01-bfda-b6126935ac64 tempest-ServersTestJSON-1545359115 tempest-ServersTestJSON-1545359115-project-member] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 710.340595] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 710.340595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.340595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.340595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.340595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.340595] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.726147] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba8e1902-2906-4d91-bc11-fccc76070805 with status ACTIVE [ 710.726384] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.726384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.726468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.726667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.726760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.726940] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.727049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.727120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.727266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.727876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.727876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.727876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.727876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.727876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.727876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.728228] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba8e1902-2906-4d91-bc11-fccc76070805 is going to be updated. [ 710.735871] env[65353]: INFO networking_nsxv3.common.synchronization [req-97ef842e-0149-4130-a17b-e9e9cb3a44eb req-a930fcc6-0922-4fab-8b9f-3b81b90bbcee tempest-TenantUsagesTestJSON-982721591 tempest-TenantUsagesTestJSON-982721591-project-member] Enqueued Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 710.736403] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 710.737479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.737479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.737479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.737479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.737479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.737479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.737813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.737813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.737813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.737882] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.753507] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.753698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.753698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.753929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.754137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.754324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8e1902-2906-4d91-bc11-fccc76070805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.815394] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.816947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.816947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.816947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.816947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.816947] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 already deleted. [ 710.816947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.889496] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2e05f4eb-7a75-49c7-9235-80993603c4d8 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 710.889821] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.889942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.890156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.890390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.890624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.890744] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e already deleted. [ 710.890838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.892088] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 710.892088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.892088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.892088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.892251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.892251] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.993678] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1bcce367-8320-4b51-ae0b-41ca7fad5717 tempest-ServersTestJSON-1545359115 tempest-ServersTestJSON-1545359115-project-member] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 710.994680] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 710.995068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.995233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.995342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.995641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.996293] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.240454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.240620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.240699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.240957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.241107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.241378] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.241550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.241698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.241790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.241867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.241942] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 already deleted. [ 711.242054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.402026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.402026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.402026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.402686] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.402934] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.403342] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.403582] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.403774] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.403977] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.404241] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.417518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.417518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.417518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.417518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.417518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.417518] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 already deleted. [ 711.417518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.428347] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.428347] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.428347] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.428347] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.428554] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-a184d629-5564-492d-af14-b9636a7d29a5 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.428740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.428784] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.429138] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.429269] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a184d629-5564-492d-af14-b9636a7d29a5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.520998] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.521161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.521217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.521441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.521530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.521618] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e already deleted. [ 711.521695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.931441] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.931713] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.931827] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.932160] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.933405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933770] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port a184d629-5564-492d-af14-b9636a7d29a5 not found, creating... [ 711.933770] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.933939] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.934431] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.934901] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.934901] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.935198] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.935447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.935572] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.935785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.935909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.936055] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: a184d629-5564-492d-af14-b9636a7d29a5 is going to be created. [ 711.938895] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2f2e123a-d832-4ae3-acbd-7cec60851736 None None] Enqueued Resource ID: d665fdfa-0da2-476d-b48e-c0e0af064417 with Priority: HIGHEST for action port [ 711.939634] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d665fdfa-0da2-476d-b48e-c0e0af064417 with Priority: HIGHEST for action port [ 711.940193] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d665fdfa-0da2-476d-b48e-c0e0af064417 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.940332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d665fdfa-0da2-476d-b48e-c0e0af064417" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.940446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d665fdfa-0da2-476d-b48e-c0e0af064417" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.940724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d665fdfa-0da2-476d-b48e-c0e0af064417" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.940820] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d665fdfa-0da2-476d-b48e-c0e0af064417',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.963265] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.963474] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.963600] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.963846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.964518] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.964832] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.125805] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 712.125805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.129034] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b3962c3f-0a3a-4a72-92dd-83f4558f4d6f tempest-ServersTestFqdnHostnames-1243309972 tempest-ServersTestFqdnHostnames-1243309972-project-member] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 712.129034] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 712.129338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.129446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.129533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.130121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.130121] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.242223] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 712.242223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.242223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.242223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.242420] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.242506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.242556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.246020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.246020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.246020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.443524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d665fdfa-0da2-476d-b48e-c0e0af064417 [ 712.443685] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.443866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.443963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.444246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.444433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.444550] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d665fdfa-0da2-476d-b48e-c0e0af064417 already deleted. [ 712.444685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d665fdfa-0da2-476d-b48e-c0e0af064417" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.652060] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.652274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.652274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.652501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.652636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.652741] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c already deleted. [ 712.652852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.696259] env[65353]: INFO networking_nsxv3.common.synchronization [req-97ef842e-0149-4130-a17b-e9e9cb3a44eb req-6333f7b8-d25c-4395-9c32-6a978ea9acb6 service nova] Enqueued Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_rules [ 712.696655] env[65353]: INFO networking_nsxv3.common.synchronization [req-97ef842e-0149-4130-a17b-e9e9cb3a44eb req-6333f7b8-d25c-4395-9c32-6a978ea9acb6 service nova] Enqueued Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 712.696655] env[65353]: INFO networking_nsxv3.common.synchronization [req-97ef842e-0149-4130-a17b-e9e9cb3a44eb req-6333f7b8-d25c-4395-9c32-6a978ea9acb6 service nova] Enqueued Resource ID: a184d629-5564-492d-af14-b9636a7d29a5 with Priority: HIGHEST for action port [ 712.697262] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_rules [ 712.697468] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 712.697734] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a184d629-5564-492d-af14-b9636a7d29a5 with Priority: HIGHEST for action port [ 712.697949] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.698113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.698198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.698508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.698616] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.699764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.699935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.699993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.700792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.701269] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.701792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.702138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.702138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.702261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.702424] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.703497] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a184d629-5564-492d-af14-b9636a7d29a5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.703497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.703497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.703719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.703719] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a184d629-5564-492d-af14-b9636a7d29a5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.748623] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.912794] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0d783c3a-29a0-4139-b390-ed1f1a0c880f tempest-ServersTestFqdnHostnames-1243309972 tempest-ServersTestFqdnHostnames-1243309972-project-member] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 712.913457] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 712.913777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.913888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.913950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.915583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.916257] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.206523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.206523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.206876] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.208111] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a184d629-5564-492d-af14-b9636a7d29a5 with status ACTIVE [ 713.208111] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.208111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.208111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.208277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.208277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.208373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.208468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.208531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.208682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.208758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.210288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.210461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.211917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.211917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.211917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.211917] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a184d629-5564-492d-af14-b9636a7d29a5 is going to be updated. [ 713.235377] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.235557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.236633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.236633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.236633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.236633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a184d629-5564-492d-af14-b9636a7d29a5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.252544] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.545452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.545608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.545746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.545921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.546049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.546283] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c already deleted. [ 713.546283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.713552] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.756724] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.756900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.756937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.757441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.757441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.757441] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 713.818854] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.818854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.818854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.819439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.819439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.836497] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 714.134300] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3a48481a-f485-44ea-a27f-2ad3f2ed1e32 None None] Enqueued Resource ID: c5130d00-4ff0-4eed-b74b-46509f5abfab with Priority: HIGHEST for action port [ 714.134984] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5130d00-4ff0-4eed-b74b-46509f5abfab with Priority: HIGHEST for action port [ 714.135323] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5130d00-4ff0-4eed-b74b-46509f5abfab taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.135467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5130d00-4ff0-4eed-b74b-46509f5abfab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.135507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5130d00-4ff0-4eed-b74b-46509f5abfab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.135758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5130d00-4ff0-4eed-b74b-46509f5abfab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.135840] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5130d00-4ff0-4eed-b74b-46509f5abfab',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.222321] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.222321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.222321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.222321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.222940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.222940] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 is going to be created. [ 714.249207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.249404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.249404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.249809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.249809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.265285] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: UNINITIALIZED for 2s [ 714.268236] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae173494-45fc-4a86-b302-46a37ea6d402 req-7e3f7c0a-9f03-4212-8f1c-935d0970a624 tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 714.269257] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 714.269700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.269832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.269912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.270221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.270402] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.270524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.270590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.270747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.270834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.270927] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.639353] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5130d00-4ff0-4eed-b74b-46509f5abfab [ 714.639584] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.639752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.639815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.640029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.640125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.640207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5130d00-4ff0-4eed-b74b-46509f5abfab already deleted. [ 714.640287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5130d00-4ff0-4eed-b74b-46509f5abfab" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.729527] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.729527] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.729527] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.729850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.730873] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.731052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.731199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.731524] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.731745] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.731987] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.732214] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.732314] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.732418] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.732560] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.732639] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.732785] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.752869] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.753083] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.753329] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.753576] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.753903] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-48694c3b-8e43-4060-9df1-013aca5fc4c0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.754084] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.754200] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.754523] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.754646] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48694c3b-8e43-4060-9df1-013aca5fc4c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.774535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.774602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.774630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.776471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.776471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.778379] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b already deleted. [ 714.778379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.257674] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.258046] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.258046] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.258983] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.258983] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.258983] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 48694c3b-8e43-4060-9df1-013aca5fc4c0 not found, creating... [ 715.258983] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.259202] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.259202] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.259367] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.259494] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.259756] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.259914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.260064] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.260280] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.260410] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.260552] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 48694c3b-8e43-4060-9df1-013aca5fc4c0 is going to be created. [ 715.277416] env[65353]: INFO networking_nsxv3.common.synchronization [req-4769a523-bbd7-4a10-aceb-edf58db18c1e req-63c21862-dd08-4ac3-bace-b05474a3bc92 tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 715.277753] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 715.278068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.278190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.278250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.278455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.278654] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ad8996a-a41c-47de-bdc2-4012d45cd90b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.283388] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.283388] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.283543] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.283703] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.283909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.284137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.800459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.800714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.800890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.801252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.801415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.801604] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b already deleted. [ 715.801777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.854363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 715.854525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.854586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.854806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.855032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.855163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.855256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.855426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.855509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.855589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.855688] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.856549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.856702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.856863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.857034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.857034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.857181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.857254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.857341] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.020694] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae173494-45fc-4a86-b302-46a37ea6d402 req-3cffa4ad-a824-40d4-8312-8fe81cf62bee service nova] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_rules [ 716.020825] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae173494-45fc-4a86-b302-46a37ea6d402 req-3cffa4ad-a824-40d4-8312-8fe81cf62bee service nova] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 716.020959] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae173494-45fc-4a86-b302-46a37ea6d402 req-3cffa4ad-a824-40d4-8312-8fe81cf62bee service nova] Enqueued Resource ID: 48694c3b-8e43-4060-9df1-013aca5fc4c0 with Priority: HIGHEST for action port [ 716.021500] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_rules [ 716.021647] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 716.021755] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48694c3b-8e43-4060-9df1-013aca5fc4c0 with Priority: HIGHEST for action port [ 716.022327] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.022538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.022538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.022810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.022876] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.027492] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.028237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.028417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.028710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.028971] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.030108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.030188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.030387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.030483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.030608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.033307] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-48694c3b-8e43-4060-9df1-013aca5fc4c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.033547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.033700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.033956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.034118] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48694c3b-8e43-4060-9df1-013aca5fc4c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.277308] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: SUCCESS [ 716.277662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.277662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.277925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.278172] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.278284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.278344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.278561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.278704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.278775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.278879] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.359286] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.359702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.359936] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.527902] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.528222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.537069] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.539433] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48694c3b-8e43-4060-9df1-013aca5fc4c0 with status ACTIVE [ 716.539531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.539607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.539673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.540245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.540455] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.540558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.540619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.540820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.540878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.542235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.542356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.542434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.542722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.542722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.542814] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48694c3b-8e43-4060-9df1-013aca5fc4c0 is going to be updated. [ 716.592159] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.592687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.593674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.593674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.593674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.593674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48694c3b-8e43-4060-9df1-013aca5fc4c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.781541] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.781686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.781748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.782025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.782264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.782378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.782434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.782599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.782681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.782764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.782913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.783027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.783089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.783228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.783364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.783447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.783512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.783653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.784252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.784252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.784252] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.863203] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.927130] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-fc2c3287-df98-4676-aa94-ac3cb5f121bc tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 716.927710] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 716.928026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.928139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.928293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.928504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.928660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.928761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.928822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.928971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.929071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.929164] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.045811] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.289694] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9cb80b2-00dd-48f3-aba0-08eecbed0594: rpc.has_security_group_logging(os_id): False [ 717.308167] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-7cec5db9-4d66-4f73-95f5-9809f0a4fbab tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 717.308744] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 717.309065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.309164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.311136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.311291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.311362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.311537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.311628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.311831] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.311933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.312073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.312187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.312267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.312462] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.312563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.312616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.312965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.312965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.313403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.313518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.313559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.313705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.313783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.313864] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 is going to be created. [ 717.368261] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.368432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.368499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.368755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.368946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.369157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 717.394864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.395065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.395138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.395316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.395489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.410476] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: IN_PROGRESS for 2s [ 717.412164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.412164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.412164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.412352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.412410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.423927] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 717.431394] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.431556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.431663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.431842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.431930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.432180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.432323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.432357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.432665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.432665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.432768] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 already deleted. [ 717.432854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.432996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.433169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.433324] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.433442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.433519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.433602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.433663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.433786] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.550048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.550268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.550345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.550670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.550733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.550799] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be created. [ 717.594555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.594796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.594866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.595137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.595376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.609935] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: UNINITIALIZED for 2s [ 717.793194] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-fb04a503-4858-4be9-94d2-0c0ce65ab2f3 tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 717.794063] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 717.794380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.794484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.939445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.939888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.939888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.940174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.940336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.940733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.941019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.941350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.941350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.941419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.941459] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 already deleted. [ 717.941545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.941715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.941872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.942088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.942192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.942256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.942451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.942536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.942661] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.348937] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.349340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.349340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.349497] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.349754] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.349902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.350015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.350371] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.350519] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.350773] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.350883] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.350982] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.351092] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.351195] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.351290] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.351414] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.375563] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.375725] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.375859] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.376040] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.376357] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.376524] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.376635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.376960] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.377125] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.447459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.447459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.447459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.447754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.447754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.447754] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 already deleted. [ 718.447835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.879522] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.879770] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.879864] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.880179] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.880323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.880470] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb not found, creating... [ 718.880762] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.880910] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.880965] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.881485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.881485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.881608] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.883405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.883405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.883405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.883405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.883405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb is going to be created. [ 718.904394] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.904657] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.904800] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.905098] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.905373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.905607] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.336475] env[65353]: INFO networking_nsxv3.common.synchronization [None req-98e37302-59b3-404f-bea5-54324d0a5d54 tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: accf81e8-bf4f-4f7e-9734-351df1f81484 with Priority: HIGHEST for action security_group_rules [ 719.337725] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accf81e8-bf4f-4f7e-9734-351df1f81484 with Priority: HIGHEST for action security_group_rules [ 719.337833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accf81e8-bf4f-4f7e-9734-351df1f81484 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.337933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.337960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.338247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.338944] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accf81e8-bf4f-4f7e-9734-351df1f81484',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.426423] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: SUCCESS [ 719.427530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.435473] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 719.435700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.436050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.436111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.436286] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.436397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.436487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.436623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.436695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.437062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.437062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.437062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.437062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.437310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.437364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.437424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.437466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.437776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.437867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.437917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.438023] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.619371] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 719.619613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.619772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.620891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.620891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.621302] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.735268] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-1f8c0f93-656f-4d68-90d1-db413d0d8085 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 719.735268] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-1f8c0f93-656f-4d68-90d1-db413d0d8085 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 719.735556] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-1f8c0f93-656f-4d68-90d1-db413d0d8085 service nova] Enqueued Resource ID: 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb with Priority: HIGHEST for action port [ 719.735936] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 719.736072] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 719.736167] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb with Priority: HIGHEST for action port [ 719.736422] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.736575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.736630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.736856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.736938] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.738939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.738939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.738939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.738939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.739183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.739183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.739280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.739376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.739465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741124] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.741124] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.741124] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.809926] env[65353]: INFO networking_nsxv3.common.synchronization [None req-da56a174-bebc-49b3-afbf-a7f1616eb720 tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: accf81e8-bf4f-4f7e-9734-351df1f81484 with Priority: HIGHEST for action security_group_rules [ 719.810823] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accf81e8-bf4f-4f7e-9734-351df1f81484 with Priority: HIGHEST for action security_group_rules [ 719.811214] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accf81e8-bf4f-4f7e-9734-351df1f81484 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.811324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.871823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.871973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.871973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.872286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.872403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.872508] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accf81e8-bf4f-4f7e-9734-351df1f81484 already deleted. [ 719.872645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.873530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.873530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.873701] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accf81e8-bf4f-4f7e-9734-351df1f81484',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.940473] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0209ced-141c-4ff9-b95c-1f2fc770b1f0: rpc.has_security_group_logging(os_id): False [ 719.963232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.963833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.963833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.963833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.963833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.964069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.964069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.964069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.964201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.964265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.964452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.966298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.966640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.967064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.967715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.968119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.970890] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 720.052051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.052557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.052557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.052872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.052946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.074939] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 720.125459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.125671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.125671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.126237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.126434] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.126547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.126774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.126774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.126973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.126973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.127190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.127190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.127330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.127330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.127470] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.127572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.127623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.127818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.127895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.127950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.127994] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.242373] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.243443] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.243580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.243925] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb with status ACTIVE [ 720.244908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.244908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.244908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.244908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.244908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.244908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.244908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.246979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.247103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.248207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.249273] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.249273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.249273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.249273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.249273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.249273] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb is going to be updated. [ 720.273663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.273831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.273919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.274246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.274434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.274715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9538cdfc-6d90-4bf7-8bc0-e1e945f95bdb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.404900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.404994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.405080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.405286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.405381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.405475] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accf81e8-bf4f-4f7e-9734-351df1f81484 already deleted. [ 720.405555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accf81e8-bf4f-4f7e-9734-351df1f81484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.630724] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b59c8a2-e271-42d7-9144-e62c90117e8b: rpc.has_security_group_logging(os_id): False [ 720.649465] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.649629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.649741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.649965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.650076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.650336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.650486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.650534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.650652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.650742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.650908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.651047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.651140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.651292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.651387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.651614] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.651709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.651789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.651906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.651977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.652089] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be created. [ 720.713782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.713944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.713991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.714213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.715046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.728315] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 720.744917] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.857903] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.857903] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-184" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.858143] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-184" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.858395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-184" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.858669] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.858810] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.858914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.859202] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.859276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.859479] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.859581] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.859679] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.859774] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.859872] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.860042] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.860137] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.884668] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.884811] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.884931] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.885128] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-184" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.885459] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-68930b31-889f-4edc-a742-9bbc7213a7d1 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.885627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.885924] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.886279] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.886399] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68930b31-889f-4edc-a742-9bbc7213a7d1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.250107] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.250107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.250107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.250107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.250107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.250107] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be created. [ 721.294419] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.294606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.294676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.294879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.295053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.307944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: UNINITIALIZED for 2s [ 721.388989] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.389342] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.389558] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.389983] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.390249] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.390483] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 68930b31-889f-4edc-a742-9bbc7213a7d1 not found, creating... [ 721.390893] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.391499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.391499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.391655] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.391879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.392452] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.392621] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.392921] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.393039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.393250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393424] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 68930b31-889f-4edc-a742-9bbc7213a7d1 is going to be created. [ 721.441701] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.441936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.442067] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.442438] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.442757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.443138] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.092580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 722.092580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.092580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.092580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.092580] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.114685] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-851cce61-3cb1-48b9-91f2-683cadcaee64 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 722.114936] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-851cce61-3cb1-48b9-91f2-683cadcaee64 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 722.115376] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-851cce61-3cb1-48b9-91f2-683cadcaee64 service nova] Enqueued Resource ID: 68930b31-889f-4edc-a742-9bbc7213a7d1 with Priority: HIGHEST for action port [ 722.115376] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 722.115376] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 722.115509] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68930b31-889f-4edc-a742-9bbc7213a7d1 with Priority: HIGHEST for action port [ 722.115964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.117329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.117564] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.117896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.117896] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-68930b31-889f-4edc-a742-9bbc7213a7d1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.118037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.118037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.118192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.118499] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68930b31-889f-4edc-a742-9bbc7213a7d1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.359228] env[65353]: INFO networking_nsxv3.common.synchronization [req-eecfff6d-4099-49b2-9de6-dc858ad3c150 req-a88eb2ed-25d8-43a5-b380-187b894bfc53 tempest-FloatingIPsAssociationTestJSON-1151398823 tempest-FloatingIPsAssociationTestJSON-1151398823-project-member] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 722.359822] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 722.360146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.360263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.360324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.360533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.360797] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.360797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.360909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.361198] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.594810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.595397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.595656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.595830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.596077] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.596465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.596465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.596565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.596659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.596794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.596933] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.622904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68930b31-889f-4edc-a742-9bbc7213a7d1 with status ACTIVE [ 722.622904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.622904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.622904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.623792] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.623792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.623792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.623882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.623927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.624329] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68930b31-889f-4edc-a742-9bbc7213a7d1 is going to be updated. [ 722.649138] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.649654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.650807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.650807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.650807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.650807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68930b31-889f-4edc-a742-9bbc7213a7d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.743529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 722.743906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.863026] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.099909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.100514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.100514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.101330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.101807] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.103041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.103553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.105379] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.105379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.105379] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.105849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.105849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.105849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.105849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.105849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.105849] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.319427] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 723.319646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.319813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.320053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.320241] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.320356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.320484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.320612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.320727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.320801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.320902] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.322494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.322782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.322986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.323189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.323298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.323493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.323624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.323830] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.367429] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.378029] env[65353]: INFO networking_nsxv3.common.synchronization [None req-afc63f9f-df7f-42e6-9207-df89f27e44cc None None] Enqueued Resource ID: 0c21fdd2-6a79-464a-8959-78f2cbf03935 with Priority: HIGHEST for action port [ 723.379320] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c21fdd2-6a79-464a-8959-78f2cbf03935 with Priority: HIGHEST for action port [ 723.379781] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c21fdd2-6a79-464a-8959-78f2cbf03935 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.379781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c21fdd2-6a79-464a-8959-78f2cbf03935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.379781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c21fdd2-6a79-464a-8959-78f2cbf03935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.380043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c21fdd2-6a79-464a-8959-78f2cbf03935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.380043] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c21fdd2-6a79-464a-8959-78f2cbf03935',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.608578] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0209ced-141c-4ff9-b95c-1f2fc770b1f0: rpc.has_security_group_logging(os_id): False [ 723.631662] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.631849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.631902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.636022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.636022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.636022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.636022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.636517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.636517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.636517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.636517] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 723.704888] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.705046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.705110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.705328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.705521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723490] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 723.828997] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.828997] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.828997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.870817] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.870994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.871050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.871382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.871589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.871690] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be updated. [ 723.885762] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c21fdd2-6a79-464a-8959-78f2cbf03935 [ 723.885954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.886119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.886292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.887091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.887091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.887091] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c21fdd2-6a79-464a-8959-78f2cbf03935 already deleted. [ 723.887091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c21fdd2-6a79-464a-8959-78f2cbf03935" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.924560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.924560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.924560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.924835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.924835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.937569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 723.975877] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.975877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.975877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.975877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.975877] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.976143] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.976143] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.976606] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.976606] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.976846] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.976846] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.976908] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.977016] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.977147] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.977221] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.977445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.998188] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.998764] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.998908] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.999110] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.999555] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-63ac8ed5-9034-4eef-ae97-228a94480e0c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.999720] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.999883] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.000427] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.001265] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63ac8ed5-9034-4eef-ae97-228a94480e0c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.332208] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.486147] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ea471e10-5078-4190-a0b9-7fc7a912d6c7 None None] Enqueued Resource ID: 3af963d9-0acd-4654-9b67-08b65005bdaf with Priority: HIGHEST for action port [ 724.486879] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af963d9-0acd-4654-9b67-08b65005bdaf with Priority: HIGHEST for action port [ 724.487534] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af963d9-0acd-4654-9b67-08b65005bdaf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.487534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af963d9-0acd-4654-9b67-08b65005bdaf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.487534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af963d9-0acd-4654-9b67-08b65005bdaf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.488102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af963d9-0acd-4654-9b67-08b65005bdaf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.488102] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af963d9-0acd-4654-9b67-08b65005bdaf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.504023] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.504023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.504023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.504023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.504023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.504023] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 63ac8ed5-9034-4eef-ae97-228a94480e0c not found, creating... [ 724.504023] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.504425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.504425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.504425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.504522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.504780] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.504923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.505053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.505257] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.505384] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.505512] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 63ac8ed5-9034-4eef-ae97-228a94480e0c is going to be created. [ 724.534660] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.534845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.534951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.535289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.535626] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.536105] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.834965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.835214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.836759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.836759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.836759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.836759] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 724.872756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.872756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.872756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.872756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.874074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.888729] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 724.990604] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3af963d9-0acd-4654-9b67-08b65005bdaf [ 724.990825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.991859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.991859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.991859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.991859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.991859] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3af963d9-0acd-4654-9b67-08b65005bdaf already deleted. [ 724.991859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af963d9-0acd-4654-9b67-08b65005bdaf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.275040] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-f08caf9a-51f5-4e99-89d6-b1da607e5fd3 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 725.275849] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-f08caf9a-51f5-4e99-89d6-b1da607e5fd3 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 725.275849] env[65353]: INFO networking_nsxv3.common.synchronization [req-148b3098-5fa0-4b7f-bf1c-0ab31ae9f743 req-f08caf9a-51f5-4e99-89d6-b1da607e5fd3 service nova] Enqueued Resource ID: 63ac8ed5-9034-4eef-ae97-228a94480e0c with Priority: HIGHEST for action port [ 725.275984] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 725.276132] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 725.276233] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ac8ed5-9034-4eef-ae97-228a94480e0c with Priority: HIGHEST for action port [ 725.277659] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.277764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.278047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.278961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.281256] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-63ac8ed5-9034-4eef-ae97-228a94480e0c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.281378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.281443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.281645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.281730] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63ac8ed5-9034-4eef-ae97-228a94480e0c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.742680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 725.742930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.784409] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63ac8ed5-9034-4eef-ae97-228a94480e0c with status ACTIVE [ 725.784684] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.785786] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.785786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.786126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.786126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.786178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.786331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.786370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.786493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.786562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.786648] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63ac8ed5-9034-4eef-ae97-228a94480e0c is going to be updated. [ 725.810077] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.810293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.810370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.810594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.810732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.810895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63ac8ed5-9034-4eef-ae97-228a94480e0c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.951702] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 725.951702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.372590] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0ce05932-5b7b-46ce-9fcb-4c204c451f1f None None] Enqueued Resource ID: 93dfe421-2748-4cae-b62f-06e8e380d26a with Priority: HIGHEST for action port [ 726.373485] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dfe421-2748-4cae-b62f-06e8e380d26a with Priority: HIGHEST for action port [ 726.373886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-93dfe421-2748-4cae-b62f-06e8e380d26a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.374245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93dfe421-2748-4cae-b62f-06e8e380d26a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.374543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93dfe421-2748-4cae-b62f-06e8e380d26a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.374841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93dfe421-2748-4cae-b62f-06e8e380d26a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.374988] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93dfe421-2748-4cae-b62f-06e8e380d26a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.444705] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0619fe10-6e62-4bc0-8dbd-ad68dfa680ed None None] Enqueued Resource ID: 1719979f-e426-4889-9f53-8e7b3182b1e4 with Priority: HIGHEST for action port [ 726.445522] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1719979f-e426-4889-9f53-8e7b3182b1e4 with Priority: HIGHEST for action port [ 726.445885] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1719979f-e426-4889-9f53-8e7b3182b1e4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.446122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1719979f-e426-4889-9f53-8e7b3182b1e4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.446272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1719979f-e426-4889-9f53-8e7b3182b1e4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.446575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1719979f-e426-4889-9f53-8e7b3182b1e4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.446710] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1719979f-e426-4889-9f53-8e7b3182b1e4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.749436] env[65353]: INFO networking_nsxv3.common.synchronization [req-aaa76914-3d37-4a46-a34c-10588ff6f6f2 req-37b68945-ce14-4f94-941d-c48f047722b0 tempest-SecurityGroupRulesTestJSON-528946329 tempest-SecurityGroupRulesTestJSON-528946329-project-member] Enqueued Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 726.750468] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b with Priority: HIGHEST for action security_group_rules [ 726.750931] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.751056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.751108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.751300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.751382] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ad8996a-a41c-47de-bdc2-4012d45cd90b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.877147] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93dfe421-2748-4cae-b62f-06e8e380d26a [ 726.877392] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.877565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.877638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.877843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.877923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.878077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93dfe421-2748-4cae-b62f-06e8e380d26a already deleted. [ 726.878193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93dfe421-2748-4cae-b62f-06e8e380d26a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.898304] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 726.898570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.898746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.899178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.899288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.899357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.899500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.900762] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900762] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.901370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.901370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.902270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.902570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.903684] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.903684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.903684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.903684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.903684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.903684] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.949143] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1719979f-e426-4889-9f53-8e7b3182b1e4 [ 726.949403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.949547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.949612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.949981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.949981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.950117] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1719979f-e426-4889-9f53-8e7b3182b1e4 already deleted. [ 726.950156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1719979f-e426-4889-9f53-8e7b3182b1e4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.280414] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.280624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.280670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.280956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.281090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.281243] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ad8996a-a41c-47de-bdc2-4012d45cd90b already deleted. [ 727.281310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ad8996a-a41c-47de-bdc2-4012d45cd90b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.404714] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5: rpc.has_security_group_logging(os_id): False [ 727.406472] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.427428] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.427566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.427638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.427850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.428071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.428145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.428239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.428305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.428451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.428522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.428700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.428856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.428856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.429396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.429396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.429396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.429396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.429396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.429732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.429732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.429732] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be created. [ 727.492807] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.492999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.492999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.493258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.493442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.509210] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 727.608524] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d4e80b12-630f-4659-822f-9480fd345922 None None] Enqueued Resource ID: 9706c740-1e92-4ca9-9476-555f84df6d06 with Priority: HIGHEST for action port [ 727.608524] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9706c740-1e92-4ca9-9476-555f84df6d06 with Priority: HIGHEST for action port [ 727.608524] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9706c740-1e92-4ca9-9476-555f84df6d06 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.608524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9706c740-1e92-4ca9-9476-555f84df6d06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.609461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9706c740-1e92-4ca9-9476-555f84df6d06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.609842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9706c740-1e92-4ca9-9476-555f84df6d06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.610117] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9706c740-1e92-4ca9-9476-555f84df6d06',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.908868] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.115659] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9706c740-1e92-4ca9-9476-555f84df6d06 [ 728.115659] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.115659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.115659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.115659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.115659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.115659] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9706c740-1e92-4ca9-9476-555f84df6d06 already deleted. [ 728.115659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9706c740-1e92-4ca9-9476-555f84df6d06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.415561] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.415561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.416600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.417185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.417681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.418042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 728.457577] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.457723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.457790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.458014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.458175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.469249] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 728.511945] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 728.512124] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 728.512794] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 728.512857] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 728.514210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.514786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.514927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.515301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.515380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.515478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.515533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.515720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.515806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.515901] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.516849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.517018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.517089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.517247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.517395] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.517489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.517549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.517689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.517771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.517862] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.568309] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 728.568309] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 728.568436] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_rules [ 728.568509] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 728.568603] env[65353]: INFO networking_nsxv3.common.synchronization [req-c96ef64d-a9f6-4a47-8b71-81757fa4cfc8 req-27b275a6-0816-44d7-92af-8a6bc65e6869 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 728.569360] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 728.569506] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_rules [ 728.569598] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 728.569694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 728.569779] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 728.571155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.571155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.571155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.571155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.571155] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.572031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.572139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.572261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.572517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.573168] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.573922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa58613-23be-4b22-ae4e-093b77a308fd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.573922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.574281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.574281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.574281] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa58613-23be-4b22-ae4e-093b77a308fd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.575544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.575544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.575544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.575544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.019338] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.021079] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.076190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.076697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.076697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.076819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.076909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa58613-23be-4b22-ae4e-093b77a308fd with status ACTIVE [ 729.077082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.077183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.077244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.077448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.077570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.077783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.078014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.078014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.078270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.078726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.081625] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.083039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.083039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.083039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.083039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.083039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa58613-23be-4b22-ae4e-093b77a308fd is going to be updated. [ 729.108335] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.108505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.108505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.108778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.108901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.108954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.265594] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3e16e515-9b11-4497-9530-bb231e80eb65 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 729.266139] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 729.266424] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.266552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.266633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.266957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.267080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.365503] env[65353]: INFO networking_nsxv3.common.synchronization [None req-19d117b4-0a15-42e5-bc1c-c43c5b1cebb8 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 729.365996] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 729.368024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.368024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.521818] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.523546] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 729.523767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.524048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.524237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.524303] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.525099] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.788818] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.788991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.789172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.789326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.789434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.789529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 already deleted. [ 729.789608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.789773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.789941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.790223] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.983860] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d43d6837-d924-44b9-94c4-06973cda33eb None None] Enqueued Resource ID: 20a05b26-debd-4b11-8314-ac6db44f2d97 with Priority: HIGHEST for action port [ 729.983860] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20a05b26-debd-4b11-8314-ac6db44f2d97 with Priority: HIGHEST for action port [ 729.984125] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-20a05b26-debd-4b11-8314-ac6db44f2d97 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.984250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20a05b26-debd-4b11-8314-ac6db44f2d97" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.984318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20a05b26-debd-4b11-8314-ac6db44f2d97" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.984591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20a05b26-debd-4b11-8314-ac6db44f2d97" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.984746] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20a05b26-debd-4b11-8314-ac6db44f2d97',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.027161] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.028084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.028440] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.028440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.028440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.028560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.028560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.029043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be created. [ 730.030572] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.030696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.030759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.030973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.031284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.031415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 730.060798] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.060967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.061016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.061232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.061460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.063543] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.063981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.063981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.063981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.064332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.076670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 730.077819] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: UNINITIALIZED for 2s [ 730.097367] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 730.097517] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 730.097618] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 730.098824] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 730.098824] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 730.098824] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 730.098824] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.098824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.099536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.099785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.099964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.100102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.100231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.100413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.100413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.100825] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.102083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.102144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.102654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.102654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_rules [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_rules [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [req-b58a667a-a978-4e62-8a2b-52b37292cada req-67b2a91b-c662-4faf-b136-a6da9c450357 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 730.160989] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_rules [ 730.161932] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 730.162300] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa58613-23be-4b22-ae4e-093b77a308fd with Priority: HIGHEST for action port [ 730.162627] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_rules [ 730.164056] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 730.164056] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 730.164056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.164056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.164056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.164056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.164056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.164625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.164853] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.167964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.167964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.167964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa58613-23be-4b22-ae4e-093b77a308fd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.167964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.167964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.168375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.168604] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa58613-23be-4b22-ae4e-093b77a308fd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.169688] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.170115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.171127] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.171127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.171127] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.171127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.334020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.334020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.334020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.334020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.334020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.334020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 already deleted. [ 730.334020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.480346] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 730.480659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.480903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481372] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.487716] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20a05b26-debd-4b11-8314-ac6db44f2d97 [ 730.487913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.488059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.488168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.488362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.488444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.488536] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20a05b26-debd-4b11-8314-ac6db44f2d97 already deleted. [ 730.488616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20a05b26-debd-4b11-8314-ac6db44f2d97" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.493608] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 730.493791] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 730.494280] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 730.494419] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 730.495268] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.495268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.495268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.495268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.495515] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.495515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.495594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.495722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.495801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.495892] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.496855] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.496855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.496954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.497853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.497853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.497853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.497853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.497853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.497853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.497853] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.543962] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_rules [ 730.544090] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 730.544217] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 730.544346] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 730.544470] env[65353]: INFO networking_nsxv3.common.synchronization [req-66532c81-4620-4b96-8f34-2821268a08af req-67ded2f5-343d-4be8-938a-8c0af47d1584 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 730.544971] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_rules [ 730.545129] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 730.545227] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 730.545321] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 730.545483] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 730.548232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.548232] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.548232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.548232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.548232] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.548775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.548775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.548775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.548775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.548775] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.549533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.549533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.549836] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.549936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.604204] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.671640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa58613-23be-4b22-ae4e-093b77a308fd with status ACTIVE [ 730.671876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.672062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.672062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.672344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.672423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.672597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.672775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.672775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.672938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.673029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.673218] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.673336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.673408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.673517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.673592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.673686] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa58613-23be-4b22-ae4e-093b77a308fd is going to be updated. [ 730.674954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.676546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.698228] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.698406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.698481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.698635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.698768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.698929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa58613-23be-4b22-ae4e-093b77a308fd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.786646] env[65353]: INFO networking_nsxv3.common.synchronization [req-93bec9d5-3349-42e2-a6dd-c89959c4be34 req-c02d581d-8ae5-4ca9-a056-72f01ce0141d tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 730.787310] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 730.787844] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.788025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.788454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.788454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.788713] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.788837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.789679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.789679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.789679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.789679] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.985763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.986027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.986552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.986835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.987465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.987465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.987465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.987590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.987634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.987860] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.988271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.988271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.988366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.988506] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.988630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.991913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.992125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.992435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.992435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.992512] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.998814] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.000040] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.050899] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.051221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.053883] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.054015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.054618] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with status ACTIVE [ 731.054618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.054618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.054618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.054921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.054921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.054972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.055143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.055143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.055257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.055334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.055514] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.055605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.055664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.055801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.055873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.055955] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 is going to be updated. [ 731.081329] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.081506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.081580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.081828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.081998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.082208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.107436] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.176353] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.176601] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.176752] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.179423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.179423] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.179423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.179423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.179423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.179423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.179854] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.179854] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.179854] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.179854] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.179972] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.180386] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.180386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.209558] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.209759] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.209981] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.210244] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.210601] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-efb62b1b-efce-47a3-b484-3dfe0437870e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.210782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.210898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.211228] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.211354] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb62b1b-efce-47a3-b484-3dfe0437870e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.292248] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.496138] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5: rpc.has_security_group_logging(os_id): False [ 731.501509] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.502812] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.523641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.523831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.523831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.524054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.524147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.524360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.524457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.524522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.524708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.524801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.524977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.525081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.525142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.525278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.525377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.525518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.525604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.525661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.525791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.525861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.525941] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 731.592039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.592294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.592422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.592766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.593384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.607386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 731.609972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.610183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.610308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.610586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.610710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.610804] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be created. [ 731.641545] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.641735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.641810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.642047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.642406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.653773] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: UNINITIALIZED for 2s [ 731.714386] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.715042] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.715042] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.715923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.715923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.715923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port efb62b1b-efce-47a3-b484-3dfe0437870e not found, creating... [ 731.716079] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.716261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.716386] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.716675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.716817] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.717176] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.717341] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.717469] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.717791] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.717992] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.718162] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: efb62b1b-efce-47a3-b484-3dfe0437870e is going to be created. [ 731.751708] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.752542] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.752542] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.752715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.752870] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.753236] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.794919] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.007046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.007295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.007481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.007755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.007910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.008055] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 732.010095] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.010241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.010279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.010489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.010577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.010733] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 is going to be created. [ 732.060024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.060024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.060024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.060024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.060024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.063026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.063488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.063686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.063992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.064289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.071721] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 in Status: UNINITIALIZED for 2s [ 732.073138] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 732.088903] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 732.089539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.090479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.091030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.092527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.092527] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.093063] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 732.093399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.093626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.093902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.094194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.094371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.094568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.094804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.094976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.095153] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.298036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.298215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.298285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.298504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.298592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.298689] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 732.331117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.331246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.331296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.331556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.331748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.340849] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 732.486811] env[65353]: INFO networking_nsxv3.common.synchronization [req-93bec9d5-3349-42e2-a6dd-c89959c4be34 req-36b88e57-fe51-43a5-add8-fa8f4f8da9aa service nova] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_rules [ 732.486811] env[65353]: INFO networking_nsxv3.common.synchronization [req-93bec9d5-3349-42e2-a6dd-c89959c4be34 req-36b88e57-fe51-43a5-add8-fa8f4f8da9aa service nova] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 732.486895] env[65353]: INFO networking_nsxv3.common.synchronization [req-93bec9d5-3349-42e2-a6dd-c89959c4be34 req-36b88e57-fe51-43a5-add8-fa8f4f8da9aa service nova] Enqueued Resource ID: efb62b1b-efce-47a3-b484-3dfe0437870e with Priority: HIGHEST for action port [ 732.487661] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_rules [ 732.487776] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 732.487853] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb62b1b-efce-47a3-b484-3dfe0437870e with Priority: HIGHEST for action port [ 732.488196] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.488483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.488699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488777] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.490783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.490783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.490783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-efb62b1b-efce-47a3-b484-3dfe0437870e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.490783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.490783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.491289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.491289] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb62b1b-efce-47a3-b484-3dfe0437870e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.597888] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.598068] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.993192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efb62b1b-efce-47a3-b484-3dfe0437870e with status ACTIVE [ 732.996030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.996030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.996030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.996765] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efb62b1b-efce-47a3-b484-3dfe0437870e is going to be updated. [ 733.024652] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.024652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.024652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.024652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.024652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.024652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efb62b1b-efce-47a3-b484-3dfe0437870e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.100248] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.102030] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.423348] env[65353]: INFO networking_nsxv3.common.synchronization [req-ec8db524-7072-4200-9dd6-4a2dfcb83d4d req-d4043851-fca2-46d8-9973-7027b5716b55 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 733.423870] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 733.424323] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.424459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.424577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.424714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.425026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.425026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.425026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.425287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.425287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.425406] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.609695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.609695] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 733.609695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.609695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.609695] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be updated. [ 733.647921] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 733.647921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.648252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.648974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.649240] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.653370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.653512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.653584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.653805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.653918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.656423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.656572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.656664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.656882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.657089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.669418] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 733.673192] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: SUCCESS [ 733.673192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.673192] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 733.673192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.673944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.673944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.673944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.673944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.674317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.674317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.674412] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.757052] env[65353]: INFO networking_nsxv3.common.synchronization [req-4d93030d-d053-4f5c-897e-256f83164657 req-dabd5af8-5e5a-4ed6-90c4-d710a287523e tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 733.757052] env[65353]: INFO networking_nsxv3.common.synchronization [req-4d93030d-d053-4f5c-897e-256f83164657 req-dabd5af8-5e5a-4ed6-90c4-d710a287523e tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 733.757052] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 with Priority: HIGHEST for action security_group_members [ 733.757052] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 733.757823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.758149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.761450] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.761683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.844086] env[65353]: INFO networking_nsxv3.common.synchronization [req-4d93030d-d053-4f5c-897e-256f83164657 req-dabd5af8-5e5a-4ed6-90c4-d710a287523e tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 733.844086] env[65353]: INFO networking_nsxv3.common.synchronization [req-4d93030d-d053-4f5c-897e-256f83164657 req-dabd5af8-5e5a-4ed6-90c4-d710a287523e tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 733.844086] env[65353]: INFO networking_nsxv3.common.synchronization [req-4d93030d-d053-4f5c-897e-256f83164657 req-dabd5af8-5e5a-4ed6-90c4-d710a287523e tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 733.844086] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_rules [ 733.844086] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 733.847150] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with Priority: HIGHEST for action port [ 733.847733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.850368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.850923] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.850923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.852384] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.852384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.852384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.852599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.852682] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.929132] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.087717] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 734.088094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.089542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 in Status: SUCCESS [ 734.089863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.090738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.090738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.090738] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.090999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.092519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.092519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.092519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.092519] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.092519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.092717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.092945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.092945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.093061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.093394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.093495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.094336] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.154580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.154580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.154580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.154580] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.177147] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.355261] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 734.355581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.355892] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 with status ACTIVE [ 734.356110] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.356237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.356319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.356523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.356599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.356768] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.356868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.356928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.358990] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.358990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.358990] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0 is going to be updated. [ 734.359310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.359906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.359906] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.359906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.359906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.359906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.359906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.360145] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.387878] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.388155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.388284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.388531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.388752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.389062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bf413dc-83a2-4eef-a30a-a6ab8ee0c1b0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.431695] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.597539] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.600453] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.600453] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.600453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.600453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 is going to be deleted. [ 734.659025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.659025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.659025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.659025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.660924] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.661102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.661258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.661802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.661802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.661802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.661802] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.662061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.662061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.664527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.664527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.664527] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.664887] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.664971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.665011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.665185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.665297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.665394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.665594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.665767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.665921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.667764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.667764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.667764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.667764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.667764] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.679904] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.864121] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.934102] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.934664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.934877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.936996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.936996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.936996] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 734.972014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.972148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.972310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.972662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.972734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.993302] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 735.103571] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.169030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5: rpc.has_security_group_logging(os_id): False [ 735.173859] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.173859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.173859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.174096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.174160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.174438] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.174591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.174656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.174885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.174989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.175171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 already deleted. [ 735.175257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.175366] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.176527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.177101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.177101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.177101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.177101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.177319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.177354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.177516] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.182605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.182846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.182846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.182958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.183032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.183351] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be updated. [ 735.199721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.200075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.200075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.200421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.200421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.200605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.201312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.201312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.201525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.201600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.201763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.201859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.201908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.202161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.202161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.202802] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.203065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.203186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.203387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.203499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.203964] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 735.222884] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.223182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.223339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.223489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.232443] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: IN_PROGRESS for 2s [ 735.284809] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.284809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.284938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.285290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.285367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.303763] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 735.366318] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.604845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.605122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.605122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.605416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.605542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.605691] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 735.642823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.643039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.643087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.643349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.643604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.654610] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 735.681045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9d2085f-6aae-4a5f-b3c8-6238ed8300d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.681821] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.681944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.682042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.682344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.682527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.682631] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.683251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.683251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.683251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.683251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.683251] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 already deleted. [ 735.683251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.684257] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 735.684455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.685303] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 735.685468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.685957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.686059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.686260] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.686357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.686357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.686489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.686550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.686682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.686749] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.687484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.688392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.688392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.688392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.688392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.688583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.688617] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.689770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.689770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.689770] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.689955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.689955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.690363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.692631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.692631] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.694178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.694384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.694999] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.695172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.695274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.695482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.695657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.695802] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.869668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.869827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.869898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.870175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.870294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.870405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 735.919860] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.920054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.920103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.920468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.920659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.934435] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 736.040094] env[65353]: INFO networking_nsxv3.common.synchronization [None req-df758b17-98c2-491e-ad2b-b9bd447b1f1b None None] Enqueued Resource ID: eb5d2edc-e5ef-4a71-96f0-3bef017172cb with Priority: HIGHEST for action port [ 736.043284] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5d2edc-e5ef-4a71-96f0-3bef017172cb with Priority: HIGHEST for action port [ 736.043284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb5d2edc-e5ef-4a71-96f0-3bef017172cb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.043284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb5d2edc-e5ef-4a71-96f0-3bef017172cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.043284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb5d2edc-e5ef-4a71-96f0-3bef017172cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.043284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb5d2edc-e5ef-4a71-96f0-3bef017172cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.043284] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb5d2edc-e5ef-4a71-96f0-3bef017172cb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.187445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9d2085f-6aae-4a5f-b3c8-6238ed8300d0: rpc.has_security_group_logging(os_id): False [ 736.190695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.190867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.197412] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.198617] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.199743] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.208850] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.208967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.209033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.209240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.209326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.209550] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.209658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.209719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.209841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.209916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.210164] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 is going to be created. [ 736.234254] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0], does not exist path=[/infra/domains/default/groups/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0]."\n}' [ 736.234254] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 [ 736.234254] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 736.295311] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.295515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.295566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.295960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.296764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.297126] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.297254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.297408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.297689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.297689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.297888] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.298057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.298116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.298248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.298328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.298417] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 is going to be created. [ 736.323783] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0], does not exist path=[/infra/domains/default/groups/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 [ 736.323996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9d2085f-6aae-4a5f-b3c8-6238ed8300d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.324658] env[65353]: Traceback (most recent call last): [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 736.324658] env[65353]: return func(*args, **kwargs) [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 736.324658] env[65353]: res.raise_for_status() [ 736.324658] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 736.324658] env[65353]: raise HTTPError(http_error_msg, response=self) [ 736.324658] env[65353]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 [ 736.324658] env[65353]: During handling of the above exception, another exception occurred: [ 736.324658] env[65353]: Traceback (most recent call last): [ 736.324658] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 736.324658] env[65353]: listener.cb(fileno) [ 736.324658] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 736.324658] env[65353]: result = function(*args, **kwargs) [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 736.324658] env[65353]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 736.324658] env[65353]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 736.324658] env[65353]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 736.324658] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 736.324658] env[65353]: res.raise_for_status() [ 736.324658] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 736.324658] env[65353]: raise HTTPError(http_error_msg, response=self) [ 736.324658] env[65353]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d9d2085f-6aae-4a5f-b3c8-6238ed8300d0 [ 736.324658] env[65353]: Removing descriptor: 18 [ 736.529138] env[65353]: INFO networking_nsxv3.common.synchronization [req-4041586e-6663-49b0-b26a-f8d72d756749 req-0a4ba6e7-361e-487b-b17c-107d79b93fd1 tempest-ImagesOneServerTestJSON-1100482761 tempest-ImagesOneServerTestJSON-1100482761-project-member] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 736.529809] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 736.531291] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.531454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.531580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.532826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.535037] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.535037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.535037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.535037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.535037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.535037] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.547990] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb5d2edc-e5ef-4a71-96f0-3bef017172cb [ 736.548265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.548394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.548457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.548672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.548790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.548974] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb5d2edc-e5ef-4a71-96f0-3bef017172cb already deleted. [ 736.549089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb5d2edc-e5ef-4a71-96f0-3bef017172cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.577364] env[65353]: INFO networking_nsxv3.common.synchronization [req-c9ce27d3-f33a-405a-ab33-30e39062ef39 req-598f631e-621c-4408-933f-76e43a856e35 tempest-MultipleCreateTestJSON-1166492687 tempest-MultipleCreateTestJSON-1166492687-project-member] Enqueued Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 736.577905] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 with Priority: HIGHEST for action security_group_members [ 736.578149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.578237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.700887] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.702318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcebdf84-f874-4db4-b283-bda9c57166cf: rpc.has_security_group_logging(os_id): False [ 736.704291] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.730509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.732039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.732180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.733041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.733041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.733041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.733481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.733481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.733575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.733732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.733876] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be created. [ 736.801453] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.801607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.801651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.801874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.820757] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 737.007826] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 737.008109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.008303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.008542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.008881] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.009020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.009020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.009162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.009271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.009365] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0209ced-141c-4ff9-b95c-1f2fc770b1f0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.038318] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.038508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.038508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.038751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.038848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.039446] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.039446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.039446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.039602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.039602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.039659] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 already deleted. [ 737.039727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.057204] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.057482] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-101" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.058334] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-101" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.058334] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-101" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.058334] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.058495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.060377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.060377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.060377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.060377] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.060377] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.060377] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.060377] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.060377] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.060377] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.060377] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.083140] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.083639] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.083639] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.083747] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-101" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.083989] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.084169] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.084275] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.084574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.084720] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.205546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.205821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.205821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.205984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.206111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.206215] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 737.208098] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.208238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.208309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.208484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.208567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.208654] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be updated. [ 737.246180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.246180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.246180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.246180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.246180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.247346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.247465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.247538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.247758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.247887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.249566] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: SUCCESS [ 737.249726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.250210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.250403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.250573] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.250761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.250761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.251172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.251329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.251399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.251490] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.257852] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 737.261219] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 737.307572] env[65353]: INFO networking_nsxv3.common.synchronization [req-05457b8d-a6df-4026-a35c-e2027bee767e req-4cc43bdf-aed8-4277-b824-2fafa752a2cb tempest-TenantUsagesTestJSON-982721591 tempest-TenantUsagesTestJSON-982721591-project-member] Enqueued Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 737.311391] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 with Priority: HIGHEST for action security_group_members [ 737.311391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9cb80b2-00dd-48f3-aba0-08eecbed0594 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.311391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.311391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.311391] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9cb80b2-00dd-48f3-aba0-08eecbed0594',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.321899] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 737.322181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.519458] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.519757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.519897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.520238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.548276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.548619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.548789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.548846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.549073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.549189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.549341] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 is going to be updated. [ 737.588994] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.590214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.590478] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.590967] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.591473] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.591844] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd not found, creating... [ 737.592584] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.592867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.593289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.593728] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.594048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.594690] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.594936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.595414] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.595762] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.595976] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.596291] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd is going to be created. [ 737.600338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.600961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.601736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.602311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.602658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.619434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: IN_PROGRESS for 2s [ 737.631386] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.631502] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.631654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.631996] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.632331] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.632642] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.667057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 737.667316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.667490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.667756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.667959] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.668103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.668173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.668330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.668411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.668495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.668593] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.670103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.670322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.670546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.670659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.670723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.670874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.670944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.671076] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.755042] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.813234] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.813451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.813451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.813614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.860675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.860985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.861132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.861203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.861451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.861554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.861652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 is going to be updated. [ 737.934851] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.935082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.935136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.935514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.935617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.951618] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 737.952779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.953096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.953313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.953557] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.953717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.953786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.953973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.954086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.954155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.954252] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.957761] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: IN_PROGRESS for 2s [ 738.175105] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.176612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.176612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.257962] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc6d712f-e111-4ee3-8ed1-729c0a27074b: rpc.has_security_group_logging(os_id): False [ 738.283033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.283033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.283033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.283033] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be created. [ 738.344775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.345633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.345758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.346041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.347390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.364075] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: IN_PROGRESS for 2s [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [req-4041586e-6663-49b0-b26a-f8d72d756749 req-b5c13812-7571-4da7-993d-f01d3c453251 service nova] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_rules [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [req-4041586e-6663-49b0-b26a-f8d72d756749 req-b5c13812-7571-4da7-993d-f01d3c453251 service nova] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [req-4041586e-6663-49b0-b26a-f8d72d756749 req-b5c13812-7571-4da7-993d-f01d3c453251 service nova] Enqueued Resource ID: 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd with Priority: HIGHEST for action port [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_rules [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 738.444454] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd with Priority: HIGHEST for action port [ 738.446523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.446707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.446801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.447126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.447860] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.449503] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.449844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.449949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.450213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.450413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.451030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.451630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.451630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.451630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.451630] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.452703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.453895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.454014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.454608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.454608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.460478] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.461989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.461989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.462360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.462580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.463428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.463428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.463428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.463592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.463728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.463951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.464972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.464972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.465325] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.680498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.811143] env[65353]: INFO networking_nsxv3.common.synchronization [None req-991da8ee-1dc5-41e3-a3f5-463036e67638 None None] Enqueued Resource ID: e3419cce-5d2f-4dd9-be84-059d061256c2 with Priority: HIGHEST for action port [ 738.811713] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3419cce-5d2f-4dd9-be84-059d061256c2 with Priority: HIGHEST for action port [ 738.812193] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3419cce-5d2f-4dd9-be84-059d061256c2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.812548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3419cce-5d2f-4dd9-be84-059d061256c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.812739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3419cce-5d2f-4dd9-be84-059d061256c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.813287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3419cce-5d2f-4dd9-be84-059d061256c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.813637] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3419cce-5d2f-4dd9-be84-059d061256c2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.859230] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 738.859230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.859230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.859230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.859230] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.942144] env[65353]: INFO networking_nsxv3.common.synchronization [req-6f8dd1bc-2484-42fd-9e83-463873aab1e8 req-11946403-96e2-4a4e-97f3-5ac9eb0ee2af tempest-ServerMetadataTestJSON-89635030 tempest-ServerMetadataTestJSON-89635030-project-member] Enqueued Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 738.942853] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGHEST for action security_group_members [ 738.943220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.943389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.943490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.944214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.944308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.944425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.944489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.945081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.945081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.945081] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.958378] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.958544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.958812] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.961694] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd with status ACTIVE [ 738.961694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.961694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.961694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.961694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.961694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.961694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.961694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.961937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.961937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.961987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.962580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.962580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.962580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.962580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.962842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.962842] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd is going to be updated. [ 738.970751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b59c8a2-e271-42d7-9144-e62c90117e8b: rpc.has_security_group_logging(os_id): False [ 738.990036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.990265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.990340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.990619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.996560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.996714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.996794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.997027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.997195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.997360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d3f4299-f0cc-4bf6-8fbe-8ae7aa3cfafd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.017996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.018301] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.018441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.020034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.020034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.020034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.020471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.020471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.020471] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 739.110104] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.110252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.110252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.110449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.110601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.139030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 739.183284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.183774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.183966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.184361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.184361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.185263] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 739.226138] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.226746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.226917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.227166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.227411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.248022] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 739.272717] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 739.273076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.274694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.274694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.274694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.276027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.276027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.276027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.276027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.276027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.278550] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 739.278824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.278996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.279266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.280104] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.280290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.280373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.280558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.280673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.281068] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.316748] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3419cce-5d2f-4dd9-be84-059d061256c2 [ 739.318315] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.318315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.318315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.318315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.318315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.318315] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3419cce-5d2f-4dd9-be84-059d061256c2 already deleted. [ 739.318315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3419cce-5d2f-4dd9-be84-059d061256c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.362572] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.362734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.448663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.448823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.448956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.449266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.461141] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.472978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.473291] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.473410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.473459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.473670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.473753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.473841] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 is going to be updated. [ 739.480985] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-a0bec560-7259-4393-a2c0-13ef29c83388 tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 739.482921] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 739.485329] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.485462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.485530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.485825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.486084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.486164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.486164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.486539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.486539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.486539] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.510701] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.510837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.510905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.511176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.511391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.520829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: IN_PROGRESS for 2s [ 739.631220] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 in Status: SUCCESS [ 739.631552] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0209ced-141c-4ff9-b95c-1f2fc770b1f0 deletion is rescheduled due to dependency. [ 739.631851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0209ced-141c-4ff9-b95c-1f2fc770b1f0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.783382] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.784372] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.960270] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.960582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.960582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.960878] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961152] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.961299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.961400] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.961613] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961754] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.961937] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.962062] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.962165] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.962283] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.962605] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.962831] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.963066] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.964912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.965087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.965211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.965514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.965611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.965766] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 is going to be created. [ 739.975803] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 in Status: SUCCESS [ 739.975803] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9cb80b2-00dd-48f3-aba0-08eecbed0594 deletion is rescheduled due to dependency. [ 739.975902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9cb80b2-00dd-48f3-aba0-08eecbed0594" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.987913] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.988082] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.988212] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.988381] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.988685] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-fdf97e46-b904-4460-85a7-abc0c485e491 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.988859] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.988967] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.989350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.989484] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf97e46-b904-4460-85a7-abc0c485e491',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.993767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.993915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.993984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.994204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.994298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.994495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.994591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.994649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.994795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.994868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.994950] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 already deleted. [ 739.995037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.996209] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.996313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.996376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.996524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.996670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.008055] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: UNINITIALIZED for 2s [ 740.286934] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.289018] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.381058] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: SUCCESS [ 740.381058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.496577] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.496577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.496814] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.497194] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.497194] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.497300] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port fdf97e46-b904-4460-85a7-abc0c485e491 not found, creating... [ 740.497644] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.497739] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.498041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.498041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.498444] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.498444] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.498565] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.499794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.499794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.499794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.499922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: fdf97e46-b904-4460-85a7-abc0c485e491 is going to be created. [ 740.529531] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.529531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.529531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.529781] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.529977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.530382] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.788522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788926] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be updated. [ 740.791893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.792115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.792115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.792347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.792447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.792546] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 740.828275] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.828469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.828952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.829659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.829659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.832396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.832590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.832695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.833018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.833252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.847311] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 740.848134] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 741.154530] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 741.154842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.252125] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-35223cbc-c55c-4b3d-aed3-ca1becfc919a service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 741.252326] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-35223cbc-c55c-4b3d-aed3-ca1becfc919a service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 741.252466] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-35223cbc-c55c-4b3d-aed3-ca1becfc919a service nova] Enqueued Resource ID: fdf97e46-b904-4460-85a7-abc0c485e491 with Priority: HIGHEST for action port [ 741.254388] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 741.254644] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 741.254857] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf97e46-b904-4460-85a7-abc0c485e491 with Priority: HIGHEST for action port [ 741.255555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.255794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.256430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.256430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.256430] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.257969] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.258113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.258181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.259225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.259225] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.259225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.259225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.259225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.259225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.259225] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.261823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf97e46-b904-4460-85a7-abc0c485e491 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.261953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.262019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.262162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.262236] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf97e46-b904-4460-85a7-abc0c485e491',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.264912] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 741.265273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.266131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.266346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.266538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.266704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.267033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.268095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.268275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.268408] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.530989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 in Status: SUCCESS [ 741.532770] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 deletion is rescheduled due to dependency. [ 741.532770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.766957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.767168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.767438] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.772871] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdf97e46-b904-4460-85a7-abc0c485e491 with status ACTIVE [ 741.773200] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.773366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.773447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.773677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.773755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.774116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.774227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.774291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.774444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.774524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.774781] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.774907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.774999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.775344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.775433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.775497] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdf97e46-b904-4460-85a7-abc0c485e491 is going to be updated. [ 741.777346] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.812336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.812516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.812590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.812880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.813104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.813277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf97e46-b904-4460-85a7-abc0c485e491" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.020459] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: SUCCESS [ 742.020796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.021268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.021723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.021723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.021964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.021964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.022141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.022141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.022286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.022508] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.181377] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-7ebdd161-33ea-4990-b5f0-55f9bb98e8e4 tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 742.181949] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 742.182635] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.182733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.271619] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.282289] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.525789] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.525789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.525789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.525789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.526061] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.526061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.526154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.526247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.526299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.526401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.526522] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.526609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.526676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.526801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.526936] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.527025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.527083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.527280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.527385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.527466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.527551] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.568036] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.569145] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.569145] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.569145] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.569393] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.569654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.569860] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.570329] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.570531] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.570826] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.570996] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.571201] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.571328] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.571476] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.571605] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.571764] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.594651] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.595437] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.595437] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.595437] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.595881] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.595881] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.596105] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.596377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.596544] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.687522] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ce7c9249-1a9d-44ee-b490-6378420d8f21 None None] Enqueued Resource ID: 75b5df30-fbdf-4d77-ac39-2fa20042f05c with Priority: HIGHEST for action port [ 742.688205] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b5df30-fbdf-4d77-ac39-2fa20042f05c with Priority: HIGHEST for action port [ 742.688592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-75b5df30-fbdf-4d77-ac39-2fa20042f05c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.688748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75b5df30-fbdf-4d77-ac39-2fa20042f05c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.688854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75b5df30-fbdf-4d77-ac39-2fa20042f05c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.689161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75b5df30-fbdf-4d77-ac39-2fa20042f05c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.689271] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75b5df30-fbdf-4d77-ac39-2fa20042f05c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.774559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.774559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.774559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.774816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.774816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774816] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be created. [ 742.783797] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.783967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.784050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.784220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.784311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.784409] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 742.799140] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.799284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.799356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.799611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.799815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.808725] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: UNINITIALIZED for 2s [ 742.816450] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.816645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.816716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.817014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.817232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.827038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 742.856738] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 742.856986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.857876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.858281] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.858401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.858473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.858643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.858725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.858814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.858975] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.859120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.859120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.859273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.859409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.859601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.859674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.860164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.860419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.860513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.860715] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.862885] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 742.863235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.863461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.863815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.863857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.864040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.864159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.864338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.864446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.864553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.864667] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.030434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5e265c-8dcf-4ba9-992c-3e96278d6735: rpc.has_security_group_logging(os_id): False [ 743.058867] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.059177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.059324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.059626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.059762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.060057] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.060272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.060436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.060932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.060932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.061177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.061341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.061445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.061659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.061801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.062072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.062352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.062456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.062664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.062785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.062924] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 is going to be created. [ 743.103824] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.103824] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.103824] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.104158] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.104382] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.104667] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b not found, creating... [ 743.105030] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.105242] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.105469] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.105851] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.106075] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.106508] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.106740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.106910] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.107259] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.107487] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.107731] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b is going to be created. [ 743.131068] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.131434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.131434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.134021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.134021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.134021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.187623] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.189296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.189450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.189680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.189883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.191262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75b5df30-fbdf-4d77-ac39-2fa20042f05c [ 743.191470] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.191591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.191658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.191850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.192747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.192747] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75b5df30-fbdf-4d77-ac39-2fa20042f05c already deleted. [ 743.192747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75b5df30-fbdf-4d77-ac39-2fa20042f05c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.216018] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: IN_PROGRESS for 2s [ 743.366708] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 743.367958] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.393087] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.393247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.393297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.394140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.419114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.419267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.419442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.419516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.419661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.419773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.419968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.420070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.420117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.420237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.420329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.420514] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.420609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.420652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.420793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.420866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.420952] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 743.488680] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.488680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.488680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.488971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.489015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.504594] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 743.724850] env[65353]: INFO networking_nsxv3.common.synchronization [req-74209a9c-733e-4114-92ea-5089ac76542b req-4d1976eb-7aa8-4163-abbc-fc4649f1d1a3 tempest-VolumesAssistedSnapshotsTest-350081951 tempest-VolumesAssistedSnapshotsTest-350081951-project-member] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 743.725240] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGHEST for action security_group_members [ 743.725488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.725679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.725754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.726242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.726242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.726382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.726382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.726498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.726598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.727070] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.870383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcebdf84-f874-4db4-b283-bda9c57166cf: rpc.has_security_group_logging(os_id): False [ 743.893446] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.893653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.893724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.894140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.894298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.894747] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.894967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.895071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.895335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.895430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.895601] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be updated. [ 743.976265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.976265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.976265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.976265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.976265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.978774] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-12631789-2a37-48be-bb95-45b6508d16aa service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 743.979160] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-12631789-2a37-48be-bb95-45b6508d16aa service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 743.979421] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-12631789-2a37-48be-bb95-45b6508d16aa service nova] Enqueued Resource ID: d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b with Priority: HIGHEST for action port [ 743.980325] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 743.980610] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 743.980812] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b with Priority: HIGHEST for action port [ 743.981612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.981860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.982249] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.982472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.982763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.983016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.983259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.983589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.983771] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.000472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 744.230539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.230733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.230779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.230978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.256826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.258325] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.258475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.258475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.259715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.259715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.259715] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 is going to be updated. [ 744.295134] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.295134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.295134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.295134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.295344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.304228] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: IN_PROGRESS for 2s [ 744.486930] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b with status ACTIVE [ 744.487202] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.487340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.487415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.487642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.487736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.487907] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.488013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.488080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.488228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.488304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.488479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.488568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.488625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.488760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.488831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.488913] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b is going to be updated. [ 744.512736] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.512943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.513009] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.513223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.513400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.513570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5682ea9-b6ec-4d75-81ca-74b8d6c9c30b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.821754] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 744.821754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.822095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.822237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.822469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.822563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.822563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.822719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.822802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.822887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.823008] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.824185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.824259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.825232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.825232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.825232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.825232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.825232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.825232] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.841033] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 744.841033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.842861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.842861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.842861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.843508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.843508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.843508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.843508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.843704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.843798] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.843924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.844518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.844518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.844518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.844518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.844518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.844729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.844729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.844799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.844904] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.908111] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-626ead80-6be1-4d38-bb9d-8f755126b260 tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 744.908674] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 744.909276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.909276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.229336] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: SUCCESS [ 745.229763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.326864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.326984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.327230] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.349735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3431123-e3cf-4858-b3b8-2bcd1acc45c7: rpc.has_security_group_logging(os_id): False [ 745.361892] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.362090] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.362199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.362474] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.362740] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.362894] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.363014] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.363223] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.363428] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.363652] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.363779] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.363904] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.364046] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.364139] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.364242] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.364443] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.370683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.370868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.370940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.371241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.384676] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.384816] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.384950] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.385154] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-405" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.385463] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-63eb5593-8919-4220-aa70-ffd9e759ae28 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.385626] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.385961] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.386139] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.386344] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63eb5593-8919-4220-aa70-ffd9e759ae28',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.393569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.393844] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.393996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.394078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.394309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.394427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.394683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.394798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.394859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.395046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.395124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.395357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.395464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.395526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.395698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.395773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.395867] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 745.467876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.468149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.468251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.468468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.468623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.487899] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 745.521889] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 745.522154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.522404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.522656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.522748] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.794029] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d630a02d-3b38-45ae-821b-623f70455325 None None] Enqueued Resource ID: 21b422b8-b0bd-4928-9684-7afc214c7f11 with Priority: HIGHEST for action port [ 745.794498] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b422b8-b0bd-4928-9684-7afc214c7f11 with Priority: HIGHEST for action port [ 745.794909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-21b422b8-b0bd-4928-9684-7afc214c7f11 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.795053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21b422b8-b0bd-4928-9684-7afc214c7f11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.795130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21b422b8-b0bd-4928-9684-7afc214c7f11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.795433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21b422b8-b0bd-4928-9684-7afc214c7f11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.795489] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21b422b8-b0bd-4928-9684-7afc214c7f11',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.831129] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.889582] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.889890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.889969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.890274] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.890481] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.890665] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 63eb5593-8919-4220-aa70-ffd9e759ae28 not found, creating... [ 745.891020] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.891220] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.891358] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.891627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.891801] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.892213] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.892350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.892538] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.892694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.892820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.892950] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 63eb5593-8919-4220-aa70-ffd9e759ae28 is going to be created. [ 745.918170] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.918513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.918513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.918780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.919011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.919255] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.015018] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 746.015231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.024992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.025264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.025371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.025692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.025951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.026138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.026253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.026487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.026607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.026751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.026871] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.299062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21b422b8-b0bd-4928-9684-7afc214c7f11 [ 746.299062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.299062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.299062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.299062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.299062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.299062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21b422b8-b0bd-4928-9684-7afc214c7f11 already deleted. [ 746.299062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21b422b8-b0bd-4928-9684-7afc214c7f11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.319572] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 in Status: SUCCESS [ 746.320045] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 deletion is rescheduled due to dependency. [ 746.320234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.334106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.334665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.334912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.335510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.335510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.335703] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 746.399189] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.399416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.399533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.399913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.400711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.414600] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 746.529839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.530113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.532173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.532511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.532756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.532907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.532994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.533229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.533329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.533437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.533618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.533720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.533782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.533928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.534104] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.534190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.534245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.534381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.534457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.534555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.534641] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.688858] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-bed3c612-f67f-4234-a6fb-0ab5181eace7 service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 746.689036] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-bed3c612-f67f-4234-a6fb-0ab5181eace7 service nova] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 746.689182] env[65353]: INFO networking_nsxv3.common.synchronization [req-ddfedc78-bc43-41f4-90f8-6abaf5b7289d req-bed3c612-f67f-4234-a6fb-0ab5181eace7 service nova] Enqueued Resource ID: 63eb5593-8919-4220-aa70-ffd9e759ae28 with Priority: HIGHEST for action port [ 746.689798] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_rules [ 746.689951] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 746.694174] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63eb5593-8919-4220-aa70-ffd9e759ae28 with Priority: HIGHEST for action port [ 746.694641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.694740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.694943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.695047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.695850] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-63eb5593-8919-4220-aa70-ffd9e759ae28 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.696048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.696048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.696412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.696412] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63eb5593-8919-4220-aa70-ffd9e759ae28',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.903706] env[65353]: INFO networking_nsxv3.common.synchronization [None req-71b5bc70-6f96-4462-a909-dfc3f61a0e4e None None] Enqueued Resource ID: ef9c4c89-7c3e-4cc0-9390-db2a5cd65903 with Priority: HIGHEST for action port [ 746.904012] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9c4c89-7c3e-4cc0-9390-db2a5cd65903 with Priority: HIGHEST for action port [ 746.904703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef9c4c89-7c3e-4cc0-9390-db2a5cd65903 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.904703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef9c4c89-7c3e-4cc0-9390-db2a5cd65903" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.904703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef9c4c89-7c3e-4cc0-9390-db2a5cd65903" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.905156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef9c4c89-7c3e-4cc0-9390-db2a5cd65903" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.905156] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef9c4c89-7c3e-4cc0-9390-db2a5cd65903',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.037405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 747.058054] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.058260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.058329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.058562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.058620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.059439] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.059439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.059526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.059683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.059762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.059974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.060077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.060173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.060582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.064027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.064027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.064027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.064027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.064027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.064027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.064027] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 747.126988] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.126988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.126988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.128442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.128442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.144282] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 747.199712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63eb5593-8919-4220-aa70-ffd9e759ae28 with status ACTIVE [ 747.199712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.199712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.199712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.199712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.200454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.200454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.200454] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63eb5593-8919-4220-aa70-ffd9e759ae28 is going to be updated. [ 747.212375] env[65353]: INFO networking_nsxv3.common.synchronization [req-94ecf3d7-45ba-454e-b269-971dc241152a req-34a7d7cc-682c-4bd7-b4c1-8ca0cc2d0b79 tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 747.213724] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 747.213827] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.213886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.214153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.214436] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.214540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.214605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.214778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.214859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.214956] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.226915] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.226915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.226915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.226915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.226915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.226915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63eb5593-8919-4220-aa70-ffd9e759ae28" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.407429] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef9c4c89-7c3e-4cc0-9390-db2a5cd65903 [ 747.408235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.408316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.408389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.408670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.408790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.408913] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef9c4c89-7c3e-4cc0-9390-db2a5cd65903 already deleted. [ 747.409055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef9c4c89-7c3e-4cc0-9390-db2a5cd65903" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.504800] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 747.504925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.505711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.505711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.505711] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.537429] env[65353]: INFO networking_nsxv3.common.synchronization [req-94ecf3d7-45ba-454e-b269-971dc241152a req-d78fef73-83c6-48d7-b10b-8bef26721bde tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 747.538384] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 747.538905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.539204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.716866] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.920163] env[65353]: INFO networking_nsxv3.common.synchronization [req-924dc4d8-0e1f-4356-b8a6-4cc6f63f3bb2 req-0eaef7ad-5481-41e1-9a0b-3819bce6d6ca tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 747.920825] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 747.925421] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.926511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.926511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.926511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.926511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.926511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.926511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.928336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.928447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.928553] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.007461] env[65353]: INFO networking_nsxv3.common.synchronization [req-94ecf3d7-45ba-454e-b269-971dc241152a req-34a46051-3c2f-486f-97c9-561b8689549d tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 748.009031] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 748.009454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.009711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.009711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.009949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.010129] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.010234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.010326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.010603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.010706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.010797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.010900] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.012336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.012336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.221921] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.352137] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.352356] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.352482] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.352738] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.353475] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.353475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.353475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.353475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.353737] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.353737] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.353841] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.353937] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.354371] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.354524] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.354694] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.354843] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.376017] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.376017] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.376017] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.376017] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.376017] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-56cdc952-d142-4bec-85b2-b9f5bb913e85 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.376271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.376271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.380019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.380019] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56cdc952-d142-4bec-85b2-b9f5bb913e85',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.424449] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 748.424686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.424850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.425075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.425259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.425387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.425453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.425614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.425695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.425788] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.433063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.433063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.433063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.433063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.453349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.453532] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.453648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.453715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.453899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.453981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.454100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 748.480227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.480637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.480963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.481247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.481482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.491987] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 748.514122] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.514272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.514340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.514557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.514729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.514821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.514885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515387] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515812] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.516120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.516195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.516276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.516365] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.725974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.726151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.726301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.726525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.726611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.726707] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 748.762081] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.762081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.762081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.762081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.762081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.771848] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 748.882637] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.882941] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.882993] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.883415] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.883676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.883926] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 56cdc952-d142-4bec-85b2-b9f5bb913e85 not found, creating... [ 748.884376] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.884666] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.884863] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.885230] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.885452] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.885951] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.886152] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.886343] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.886671] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.886903] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.887225] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 56cdc952-d142-4bec-85b2-b9f5bb913e85 is going to be created. [ 748.910499] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.910632] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.910877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.912365] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.912365] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.912365] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.929284] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.018937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3431123-e3cf-4858-b3b8-2bcd1acc45c7: rpc.has_security_group_logging(os_id): False [ 749.056470] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.058962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.058962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.058962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.059903] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.062110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.062110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.062110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.062110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.062110] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 749.134326] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.134633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.134633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.134856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.135048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.154219] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 749.160822] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 749.161070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.432185] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.508019] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f7085f9d-98f0-400a-86ca-c12880f8d74c None None] Enqueued Resource ID: 77903ff0-9ec5-4a60-bcaa-0423816dcb83 with Priority: HIGHEST for action port [ 749.508019] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77903ff0-9ec5-4a60-bcaa-0423816dcb83 with Priority: HIGHEST for action port [ 749.508019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-77903ff0-9ec5-4a60-bcaa-0423816dcb83 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.508019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77903ff0-9ec5-4a60-bcaa-0423816dcb83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.508019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77903ff0-9ec5-4a60-bcaa-0423816dcb83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.508754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77903ff0-9ec5-4a60-bcaa-0423816dcb83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.508930] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77903ff0-9ec5-4a60-bcaa-0423816dcb83',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.679402] env[65353]: INFO networking_nsxv3.common.synchronization [req-924dc4d8-0e1f-4356-b8a6-4cc6f63f3bb2 req-e8174993-7334-4fe8-a8ea-dc2d85747542 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 749.679402] env[65353]: INFO networking_nsxv3.common.synchronization [req-924dc4d8-0e1f-4356-b8a6-4cc6f63f3bb2 req-e8174993-7334-4fe8-a8ea-dc2d85747542 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 749.679402] env[65353]: INFO networking_nsxv3.common.synchronization [req-924dc4d8-0e1f-4356-b8a6-4cc6f63f3bb2 req-e8174993-7334-4fe8-a8ea-dc2d85747542 service nova] Enqueued Resource ID: 56cdc952-d142-4bec-85b2-b9f5bb913e85 with Priority: HIGHEST for action port [ 749.680367] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 749.680367] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 749.680492] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56cdc952-d142-4bec-85b2-b9f5bb913e85 with Priority: HIGHEST for action port [ 749.681513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.681513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.681513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.681513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.681513] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.682593] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.682716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.683227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-56cdc952-d142-4bec-85b2-b9f5bb913e85 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.683227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.683227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.686689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.686689] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56cdc952-d142-4bec-85b2-b9f5bb913e85',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.934567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.934952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.934952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.935611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.935611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.935611] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 749.970739] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.971227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.971227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.971357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.972037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.986393] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 750.011032] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77903ff0-9ec5-4a60-bcaa-0423816dcb83 [ 750.011158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.011232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.012021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.012021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.012021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.012021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77903ff0-9ec5-4a60-bcaa-0423816dcb83 already deleted. [ 750.012021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77903ff0-9ec5-4a60-bcaa-0423816dcb83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.185663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.185663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.188415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56cdc952-d142-4bec-85b2-b9f5bb913e85 with status ACTIVE [ 750.188892] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.192413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.192413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.192413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.192413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56cdc952-d142-4bec-85b2-b9f5bb913e85 is going to be updated. [ 750.216405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.216800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.216800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.216992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.217085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.217263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56cdc952-d142-4bec-85b2-b9f5bb913e85" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.501650] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 750.501650] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 750.501913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.502073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.503034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.503034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.503221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.503363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.503511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.503607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.504029] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.788063] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 750.788375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.788741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.788999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.790757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.790757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.790757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.790757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.790757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.790757] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.008226] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.178881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 751.179287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.293182] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.293182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.293182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.293675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.314049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.314307] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.314434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.314502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.314713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.314810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.314884] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 751.352721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.352721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.353219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.353219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.353219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.362544] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 751.511033] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.996681] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 751.996882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.997810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.997810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.998089] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.016264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.016264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.016264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.016264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.016264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.016264] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 752.050312] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.050563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.051583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.051583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.051583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.064754] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 752.502344] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.502344] env[65353]: INFO networking_nsxv3.common.synchronization [req-75c76140-9911-40ae-be9d-ec817518307c req-b62a9852-9c9c-48a6-9962-4ff7d8b57c24 tempest-ServerAddressesTestJSON-2051333294 tempest-ServerAddressesTestJSON-2051333294-project-member] Enqueued Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 752.503947] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 752.504538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.504728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.504783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.505100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.505268] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.505371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.505436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.505789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.505896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.505997] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.005121] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.008948] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.009104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.009173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.009391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.009485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.009683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.009779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.009840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.009989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.010130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.010176] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 already deleted. [ 753.010340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.090896] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.091246] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-506" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.091246] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-506" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.091505] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-506" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.091761] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.092242] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.092391] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.093054] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.093214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.093459] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.093704] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.093828] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.093936] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.094107] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.094195] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.094361] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.116994] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.117184] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.117600] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.117868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-506" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.118215] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-c281f12b-66b0-4f51-b65a-e48d93de02bc taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.118382] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.118506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.118822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.118955] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c281f12b-66b0-4f51-b65a-e48d93de02bc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.374431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 753.374621] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 deletion is rescheduled due to dependency. [ 753.374823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.375008] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.375465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.375465] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.375674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.375674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.376288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.376288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.376288] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.509543] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.509543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.509543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.509543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.509543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.509543] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 753.544167] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.544395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.544395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.546031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.546031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.555619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 753.622333] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.622736] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.623048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.623296] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.623539] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.623783] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port c281f12b-66b0-4f51-b65a-e48d93de02bc not found, creating... [ 753.624215] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.624479] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.624694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.625410] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.625671] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.626143] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.626405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.626819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.627285] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.627448] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.627703] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: c281f12b-66b0-4f51-b65a-e48d93de02bc is going to be created. [ 753.664045] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.664625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.664625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.664853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.665151] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.665435] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.883065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.883289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.883429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.883741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.883865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.884091] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.884215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.884340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.884532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.884617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.884764] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 753.914920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.915173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.915886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.915886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.915886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.927087] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 754.079243] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 754.079804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.079804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.080239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.080635] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.081527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.081527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.081527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.081527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.081769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.081769] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.367736] env[65353]: INFO networking_nsxv3.common.synchronization [req-75c76140-9911-40ae-be9d-ec817518307c req-c241e8b1-373b-45b5-8775-e54fd95a6e33 service nova] Enqueued Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_rules [ 754.368368] env[65353]: INFO networking_nsxv3.common.synchronization [req-75c76140-9911-40ae-be9d-ec817518307c req-c241e8b1-373b-45b5-8775-e54fd95a6e33 service nova] Enqueued Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 754.369807] env[65353]: INFO networking_nsxv3.common.synchronization [req-75c76140-9911-40ae-be9d-ec817518307c req-c241e8b1-373b-45b5-8775-e54fd95a6e33 service nova] Enqueued Resource ID: c281f12b-66b0-4f51-b65a-e48d93de02bc with Priority: HIGHEST for action port [ 754.370942] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_rules [ 754.371161] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 754.371296] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c281f12b-66b0-4f51-b65a-e48d93de02bc with Priority: HIGHEST for action port [ 754.371886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.372504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.372610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.372987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.373142] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.377092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.377092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.377092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.377092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.377092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.378254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.378388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.379059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.379059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.379167] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.381966] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c281f12b-66b0-4f51-b65a-e48d93de02bc taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.381966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.381966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.382324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.382324] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c281f12b-66b0-4f51-b65a-e48d93de02bc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.584226] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.584422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.584422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.584596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.584826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.584972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.585051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.585247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.585337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.585425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.585590] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.585670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.585730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.585958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.586131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.586224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.586285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.586441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.586574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.586663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.586766] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.886195] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.887358] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.887358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887358] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c281f12b-66b0-4f51-b65a-e48d93de02bc with status ACTIVE [ 754.887721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.887721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.887893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.887999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.888202] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.888307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.888371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.888560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.888652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.888978] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.888978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.889863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.890226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.890353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.890528] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c281f12b-66b0-4f51-b65a-e48d93de02bc is going to be updated. [ 754.919039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.919205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.919320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.919511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.921121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.921121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c281f12b-66b0-4f51-b65a-e48d93de02bc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.089966] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef90e1f-f512-4c74-82f2-c918b64f5aee: rpc.has_security_group_logging(os_id): False [ 755.114662] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.114839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.114910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.115190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.115272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.115470] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.115569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.115615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.115765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.115839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.116049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.116144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.116207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.116687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.116687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.116687] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.116687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.116845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.116845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.116907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.116996] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 755.190908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.191094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.191246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.191376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.191528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.210688] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 755.349062] env[65353]: INFO networking_nsxv3.common.synchronization [req-40275247-e3a1-48a6-b147-d99d78f7e03f req-893e8af6-3962-452d-9d8c-94341559271e tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 755.349781] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 755.350213] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.350355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.350398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.354022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.354022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.354022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.354022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.354022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.354022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.354022] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.393776] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.572039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 755.572958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.572958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.573330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.573403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.573832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.573832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.573992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.574289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.574488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.575154] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.575154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.575154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.577027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.577027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.577027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.578302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.578795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.579826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.579826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.579826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.579826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.579826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.579826] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.854345] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.883143] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.883485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.883594] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.883858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.884116] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.884303] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.884487] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.884869] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.885122] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.885454] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.885604] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.885749] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.885901] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.886049] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.886195] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.886367] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.895668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.895886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.895886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.896978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.896978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.896978] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 is going to be created. [ 755.918965] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.918965] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.918965] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.918965] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.918965] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-5bf1a18b-1f7d-4777-a181-870521577587 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.919428] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.919428] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.919879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.920068] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf1a18b-1f7d-4777-a181-870521577587',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.937817] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.937817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.937817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.938217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.938217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.941779] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 755.941964] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 deletion is rescheduled due to dependency. [ 755.942095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.949172] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: UNINITIALIZED for 2s [ 756.082622] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 576f0f86-448d-4fa9-9110-1b5ac65e3d65: rpc.has_security_group_logging(os_id): False [ 756.084544] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.114870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.114870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.114870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.115163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.115163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.115405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.115632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.115788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.116565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.116565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.116565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.116565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.116776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.117013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.117107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.117381] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.117488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.117648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.117779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.117931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.118047] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be created. [ 756.210853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.210853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.210853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.210853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.210853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.228532] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 756.357471] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.423222] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.423662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.423662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.423861] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.424016] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.424170] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 5bf1a18b-1f7d-4777-a181-870521577587 not found, creating... [ 756.424435] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.424591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.424743] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.424996] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.425202] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.425496] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.425635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.425787] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.426080] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.426250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.426404] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 5bf1a18b-1f7d-4777-a181-870521577587 is going to be created. [ 756.456944] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.457104] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.457140] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.457456] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.457688] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.457928] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.588423] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.860235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.860444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.860444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.860679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.860797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.860901] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 756.906032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.906032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.906032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.906032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.906032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.921062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 757.089447] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae30a7eb-b153-48a3-8c68-c941eea5a46e req-369ed2e3-ec1d-4361-b08f-67269155dc3e tempest-FloatingIPsAssociationTestJSON-1151398823 tempest-FloatingIPsAssociationTestJSON-1151398823-project-member] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 757.090077] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGHEST for action security_group_members [ 757.090483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.090636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.090779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.090986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.093297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.093297] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 757.095130] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.095296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.095394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.095849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.095849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.097677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.097677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.097677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.097677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.097677] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.145733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.145733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.145733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.145733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.145733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.157036] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 757.237210] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 757.237210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.238262] env[65353]: INFO networking_nsxv3.common.synchronization [req-40275247-e3a1-48a6-b147-d99d78f7e03f req-2dcb146f-ddb5-4251-abcd-0bbdbb227569 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 757.238669] env[65353]: INFO networking_nsxv3.common.synchronization [req-40275247-e3a1-48a6-b147-d99d78f7e03f req-2dcb146f-ddb5-4251-abcd-0bbdbb227569 service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 757.239097] env[65353]: INFO networking_nsxv3.common.synchronization [req-40275247-e3a1-48a6-b147-d99d78f7e03f req-2dcb146f-ddb5-4251-abcd-0bbdbb227569 service nova] Enqueued Resource ID: 5bf1a18b-1f7d-4777-a181-870521577587 with Priority: HIGHEST for action port [ 757.240684] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 757.242694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 757.242694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf1a18b-1f7d-4777-a181-870521577587 with Priority: HIGHEST for action port [ 757.242694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.242694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.242694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.242694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.242694] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.247143] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.247143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.247143] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf1a18b-1f7d-4777-a181-870521577587 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.247143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.247143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.247143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.247143] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf1a18b-1f7d-4777-a181-870521577587',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.281595] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c3f4ff51-6909-4180-bbc6-e0bb032ba283 tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 757.282571] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 757.282756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.282861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.282921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.283197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.283370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.427814] env[65353]: INFO networking_nsxv3.common.synchronization [None req-bb802e63-0f06-4575-86a0-fe4efd9e6fd0 tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 757.430173] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 757.430173] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.430173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.600475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.600475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.600475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.600475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.624323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.624592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.624738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.624813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.625431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.625431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.625431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be updated. [ 757.684569] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.684980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.684980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.685132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.685314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.703184] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: IN_PROGRESS for 2s [ 757.744541] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.744541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.755030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bf1a18b-1f7d-4777-a181-870521577587 with status ACTIVE [ 757.755030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.755030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.755030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.755030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.755030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bf1a18b-1f7d-4777-a181-870521577587 is going to be updated. [ 757.788356] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.788356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.788356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.788356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.788356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.788356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf1a18b-1f7d-4777-a181-870521577587" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.821374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.821374] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 already deleted. [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.821374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.821374] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.962089] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: SUCCESS [ 757.962325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.962588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.962805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.962997] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.963128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.963195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.963343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.963437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.963531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.963636] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.053599] env[65353]: INFO networking_nsxv3.common.synchronization [req-0848831c-f456-4b5d-84ba-ffa3ef611dc6 req-824dd12a-67df-4924-a895-272b56b42cb8 tempest-ServerRescueTestJSONUnderV235-2043192660 tempest-ServerRescueTestJSONUnderV235-2043192660-project-member] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 758.053964] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGHEST for action security_group_members [ 758.054502] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.054610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.054610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.054846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.055012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.055118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.055181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.055336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.055421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.055540] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.244851] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 758.244851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.244851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.246613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.246613] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.343922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.344097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.344147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.344351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.344444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.344536] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 already deleted. [ 758.344738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.467044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.467374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.467374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.467559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.467658] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.467795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.467855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.467964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.468079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.468179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.468485] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.468485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.468485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.468804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.468804] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.468923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.468923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.469078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.469132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.469194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.469259] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.562028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.562028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.562028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.562028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be updated. [ 758.596612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.596612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.596612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.596612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.596612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.604542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: IN_PROGRESS for 2s [ 758.748361] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.748361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.934161] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 758.934443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.934672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.934977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.935205] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.935342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.935434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.935602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.935703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.935833] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.973070] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0678802a-91aa-46fa-8b87-44cd93c89d75: rpc.has_security_group_logging(os_id): False [ 758.993517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.993666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.993774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.993960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.994072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.994486] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.994486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.994486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.994670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.994775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.994996] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.995191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.995191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.995364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.995536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.996472] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.996472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.996743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.996813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.997031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.997031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 is going to be created. [ 759.090722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.091894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.091894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.091894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.091894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.106770] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: IN_PROGRESS for 2s [ 759.168406] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 759.169214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.169214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.169214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.169628] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.169829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.169926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.170154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.170523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.170523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.170523] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.441899] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.673056] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.673056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.673056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.673559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.673559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.673833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.673996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.674221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.674313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.674405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.674566] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.674692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.674798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.674939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.675346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.675346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.675346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.675346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.675509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.675509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.675601] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.717349] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a in Status: SUCCESS [ 759.718265] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a deletion is rescheduled due to dependency. [ 759.718265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.945456] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.178502] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 576f0f86-448d-4fa9-9110-1b5ac65e3d65: rpc.has_security_group_logging(os_id): False [ 760.201055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.201163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.201202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.201509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.202410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.202410] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.202410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.202410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.202410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.202410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.202757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.202757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.202757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.202862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.202923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.203423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.203423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.203538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.203664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.203718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.203778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 760.277862] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.278024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.278101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.278435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.278596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.293686] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 760.449356] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.449496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.449581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.449907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.450045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.450177] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 760.498172] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.498416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.498416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.498993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.498993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.509053] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 760.617179] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 in Status: SUCCESS [ 760.617179] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 deletion is rescheduled due to dependency. [ 760.617519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.121712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: SUCCESS [ 761.122067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.208060] env[65353]: INFO networking_nsxv3.common.synchronization [req-7842e0cb-20d1-4250-8904-15e7872ac9f7 req-57ef480e-cd0e-4f7c-9b8d-2d74be6e99e0 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 762.208608] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 762.208913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.209043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.209211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.209396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.209517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.209638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.209737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.209912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.209912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.210048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.314900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 762.315149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.315334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.315583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.315674] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.522744] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 762.523278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.523559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.525196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.525196] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.525196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.525196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.525650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.525650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.525650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.525650] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.712738] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.713082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.713369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.713827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.714047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.714582] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.714843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.714961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.715336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.715460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.715654] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 already deleted. [ 762.715920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.727237] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.727605] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.727605] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.727943] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.728242] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.728506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.728648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.728941] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.729144] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.729738] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.729738] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.729738] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.729738] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.731077] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.731077] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.731077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.754039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.754039] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.754039] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.754341] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.754574] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.754749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.754889] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.755724] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.755724] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c766cb5-95c2-4905-b0c4-b3e1a6e27218',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.818352] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.818626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.818626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.818828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.819038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.819150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.819228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.819380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.819472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.819613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.819697] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.028944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.029218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.029289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.029642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.029926] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.030129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.030270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.030540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.030718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.030865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.031136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.031291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.031394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.031657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.031881] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.032082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.032224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.032414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.032610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.032752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.032942] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.068906] env[65353]: INFO networking_nsxv3.common.synchronization [req-67a4dcda-b983-475a-83b1-bec2587aceb2 req-65bc5b46-54c2-479e-91ad-683582481f1b tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 763.069593] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 763.070615] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.070615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.070839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.071025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.071255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.071444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.071524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.071812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.071911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.072020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.262026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.262026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 not found, creating... [ 763.262026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.262026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.263312] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.263312] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.263312] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.268181] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.268181] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.268181] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 is going to be created. [ 763.294392] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.295038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.295306] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.295677] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.296025] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.296353] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.323059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.323059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.423853] env[65353]: INFO networking_nsxv3.common.synchronization [None req-768b8169-4b46-4ba9-8539-ff203f7f4c0d None None] Enqueued Resource ID: e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9 with Priority: HIGHEST for action port [ 763.424299] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9 with Priority: HIGHEST for action port [ 763.425014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.425148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.425206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.425527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.425618] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.539037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2f635c3-4601-4155-b8e5-e2dab677e518: rpc.has_security_group_logging(os_id): False [ 763.557433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.557648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.557735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.557984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.574837] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.584246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.585290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.585518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.585675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.586054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.586217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.586548] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.586711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.586823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.587803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.587963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.588300] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.588429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.588479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.588681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.588868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.589271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 763.668969] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.669265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.669378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.669741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.669986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.692297] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 763.931523] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9 [ 763.931790] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.931929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.931997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.932347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.932347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.932547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9 already deleted. [ 763.932547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0ff07e5-6ff9-49ae-9cda-ee1f31462dd9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.078940] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.585634] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.585912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.585912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.586060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.586216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.586323] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 764.624533] env[65353]: INFO networking_nsxv3.common.synchronization [req-7842e0cb-20d1-4250-8904-15e7872ac9f7 req-4e203d5c-68ec-4352-b7b8-c4d0d71a0890 service nova] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 764.624608] env[65353]: INFO networking_nsxv3.common.synchronization [req-7842e0cb-20d1-4250-8904-15e7872ac9f7 req-4e203d5c-68ec-4352-b7b8-c4d0d71a0890 service nova] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 764.629544] env[65353]: INFO networking_nsxv3.common.synchronization [req-7842e0cb-20d1-4250-8904-15e7872ac9f7 req-4e203d5c-68ec-4352-b7b8-c4d0d71a0890 service nova] Enqueued Resource ID: 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 with Priority: HIGHEST for action port [ 764.629544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.629544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.629544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.629544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.629544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.631080] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 764.631328] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 764.631458] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 with Priority: HIGHEST for action port [ 764.631877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.632557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.632615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.633965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.634487] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.639608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.639608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.639608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.639608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.639608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.640537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.640537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.640537] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c766cb5-95c2-4905-b0c4-b3e1a6e27218',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.654752] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 765.144468] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.144734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.145098] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.148349] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 with status ACTIVE [ 765.148629] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.148768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.148955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.149115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.149237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.149454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.149644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.149770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.150041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.150180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.150519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.150665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.150792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.151092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.151231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.151368] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c766cb5-95c2-4905-b0c4-b3e1a6e27218 is going to be updated. [ 765.179563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.179841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.179841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.180111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.180336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.180583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c766cb5-95c2-4905-b0c4-b3e1a6e27218" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.647828] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.714055] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 765.714657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.760468] env[65353]: INFO networking_nsxv3.common.synchronization [None req-bb6755b2-8033-475c-8124-6537367e65d4 None None] Enqueued Resource ID: 4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21 with Priority: HIGHEST for action port [ 765.761391] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21 with Priority: HIGHEST for action port [ 765.761858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.761967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.762064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.762427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.762576] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.158437] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.158666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.158729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.159020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.159131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.159224] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be created. [ 766.186727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.186995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.186995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.187096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.187207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.199118] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: UNINITIALIZED for 2s [ 766.265083] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21 [ 766.265083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.265309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.265309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.267039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.267039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.267039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21 already deleted. [ 766.267039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cfa7ef6-6a3f-4a4a-8f08-b8cf131fcf21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.666919] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 766.667307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.667428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.667691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.667907] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.668040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.668139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.668276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.668365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.668500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.668670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.668765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.668912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.669015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.669145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.669237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.669302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.669486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.669567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.669650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.669756] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.172164] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 576f0f86-448d-4fa9-9110-1b5ac65e3d65: rpc.has_security_group_logging(os_id): False [ 767.193705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.193922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.193984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.194205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.194302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.194515] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.194625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.194707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.194924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.194991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.195220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.195310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.195372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.195510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.195584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.195765] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.195845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.195914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.196070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.196132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.196209] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 767.259325] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.259546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.259621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.259890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.260019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.275092] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 768.211378] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 768.211689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.211779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.212059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.212259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.212376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.212444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.212635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.212718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.212776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.212890] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.715106] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.218777] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e4cc2e-7db9-4ecb-adb0-1ff58af51797: rpc.has_security_group_logging(os_id): False [ 769.238840] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.239034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.239092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.239297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.239403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.239644] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.239741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.239804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.240014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.240127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.240219] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be created. [ 769.297434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 769.297702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.322989] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.323234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.323234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.323440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.323631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.337374] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 770.762155] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.762484] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 771.357751] env[65353]: INFO networking_nsxv3.common.synchronization [req-e8e50e68-edbe-4ab4-adbf-2023484eefc0 req-1f7f8fef-d25d-4816-af22-df1f2949c72d tempest-ServersTestJSON-1545359115 tempest-ServersTestJSON-1545359115-project-member] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 771.362288] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 771.362502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.363207] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 771.363753] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.363864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.363901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.364201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.364406] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.364538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.364612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.364860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.364944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.365034] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.867820] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.868138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.869458] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.869458] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e already deleted. [ 771.869458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.956514] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.956861] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-796" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.957080] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-796" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.957532] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-796" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.957893] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.958177] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.958378] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.958693] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.958913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.959378] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.959552] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.959724] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.959894] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.960077] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.960248] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.960494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.989399] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.989622] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.989694] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.989854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-796" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.990222] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-895c9197-4f96-4dd7-b78b-e190fb03ace9 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.990352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.990463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.990852] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.991013] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895c9197-4f96-4dd7-b78b-e190fb03ace9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.493588] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.494208] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.494208] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.494417] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.494417] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.494543] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 895c9197-4f96-4dd7-b78b-e190fb03ace9 not found, creating... [ 772.494848] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.494988] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.495115] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.495334] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.495468] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.495802] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.495956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.496087] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.496288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.496856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.496856] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 895c9197-4f96-4dd7-b78b-e190fb03ace9 is going to be created. [ 772.517518] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.517518] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.517518] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.517819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.517985] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.518214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.212694] env[65353]: INFO networking_nsxv3.common.synchronization [req-e8e50e68-edbe-4ab4-adbf-2023484eefc0 req-518c132d-b516-4f1b-89e8-f434cb557f7c service nova] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 773.213047] env[65353]: INFO networking_nsxv3.common.synchronization [req-e8e50e68-edbe-4ab4-adbf-2023484eefc0 req-518c132d-b516-4f1b-89e8-f434cb557f7c service nova] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 773.213240] env[65353]: INFO networking_nsxv3.common.synchronization [req-e8e50e68-edbe-4ab4-adbf-2023484eefc0 req-518c132d-b516-4f1b-89e8-f434cb557f7c service nova] Enqueued Resource ID: 895c9197-4f96-4dd7-b78b-e190fb03ace9 with Priority: HIGHEST for action port [ 773.213877] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_rules [ 773.214156] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 773.214303] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 895c9197-4f96-4dd7-b78b-e190fb03ace9 with Priority: HIGHEST for action port [ 773.214865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.214865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.214976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.215103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.215191] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.216775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.216894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.216971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.217284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.217284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.217421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.217421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.217586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.217635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.217736] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.218561] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-895c9197-4f96-4dd7-b78b-e190fb03ace9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.218664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.218732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.218885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.218964] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895c9197-4f96-4dd7-b78b-e190fb03ace9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.719502] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.719637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.721988] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 895c9197-4f96-4dd7-b78b-e190fb03ace9 with status ACTIVE [ 773.722198] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.722317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.722385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.722667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.722766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.722943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.723052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.723147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.723266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.723343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.723523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.723633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.723699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.723837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.723908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.723990] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 895c9197-4f96-4dd7-b78b-e190fb03ace9 is going to be updated. [ 773.725853] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.749026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.749172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.749247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.749450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.749580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.749739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-895c9197-4f96-4dd7-b78b-e190fb03ace9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.229695] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.390212] env[65353]: INFO networking_nsxv3.common.synchronization [None req-37f1dcd3-794d-44dd-abf0-376f42d9b9d8 None None] Enqueued Resource ID: d12c2f44-7682-463b-bd19-1b1cfc43a7b9 with Priority: HIGHEST for action port [ 774.390212] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d12c2f44-7682-463b-bd19-1b1cfc43a7b9 with Priority: HIGHEST for action port [ 774.390212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d12c2f44-7682-463b-bd19-1b1cfc43a7b9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.390212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d12c2f44-7682-463b-bd19-1b1cfc43a7b9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.390212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d12c2f44-7682-463b-bd19-1b1cfc43a7b9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.390212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d12c2f44-7682-463b-bd19-1b1cfc43a7b9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.390212] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d12c2f44-7682-463b-bd19-1b1cfc43a7b9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.734651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.734869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.734982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.735273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.735372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.735471] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e is going to be created. [ 774.759972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.760314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.760314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.760314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.761331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.772103] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: UNINITIALIZED for 2s [ 774.809657] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b93253de-e364-40ce-b549-8213c16539ba None None] Enqueued Resource ID: dad0fd2b-d21a-4790-bbc9-29bc408faaa9 with Priority: HIGHEST for action port [ 774.810315] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad0fd2b-d21a-4790-bbc9-29bc408faaa9 with Priority: HIGHEST for action port [ 774.811297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-dad0fd2b-d21a-4790-bbc9-29bc408faaa9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.811721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dad0fd2b-d21a-4790-bbc9-29bc408faaa9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.811874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dad0fd2b-d21a-4790-bbc9-29bc408faaa9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.812428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dad0fd2b-d21a-4790-bbc9-29bc408faaa9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.812428] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad0fd2b-d21a-4790-bbc9-29bc408faaa9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.891372] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d12c2f44-7682-463b-bd19-1b1cfc43a7b9 [ 774.891882] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.892090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.892167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.892395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.892490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.892634] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d12c2f44-7682-463b-bd19-1b1cfc43a7b9 already deleted. [ 774.892732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d12c2f44-7682-463b-bd19-1b1cfc43a7b9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.315745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dad0fd2b-d21a-4790-bbc9-29bc408faaa9 [ 775.316496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.316496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.316496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.316496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.316671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.316671] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dad0fd2b-d21a-4790-bbc9-29bc408faaa9 already deleted. [ 775.316811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dad0fd2b-d21a-4790-bbc9-29bc408faaa9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.542943] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f768b734-b6c8-4b4f-8481-e31623a92924 None None] Enqueued Resource ID: ee0bb253-aa07-4439-9531-584be73a1f32 with Priority: HIGHEST for action port [ 775.543646] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0bb253-aa07-4439-9531-584be73a1f32 with Priority: HIGHEST for action port [ 775.544138] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee0bb253-aa07-4439-9531-584be73a1f32 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.544615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee0bb253-aa07-4439-9531-584be73a1f32" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.544615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee0bb253-aa07-4439-9531-584be73a1f32" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.544768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee0bb253-aa07-4439-9531-584be73a1f32" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.545258] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee0bb253-aa07-4439-9531-584be73a1f32',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.004056] env[65353]: INFO networking_nsxv3.common.synchronization [req-aa496dd9-24bf-49e1-accc-2b741804e56b req-44147e91-30bd-4bae-a4fe-c2fafea7a2e7 tempest-ServersTestFqdnHostnames-1243309972 tempest-ServersTestFqdnHostnames-1243309972-project-member] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 776.005259] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 776.005786] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.005928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.005990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.006295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.006488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.006671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.006671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.007093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.007189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.007285] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.051014] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee0bb253-aa07-4439-9531-584be73a1f32 [ 776.051014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.051014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.051252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.051252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.051393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.051581] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee0bb253-aa07-4439-9531-584be73a1f32 already deleted. [ 776.051687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee0bb253-aa07-4439-9531-584be73a1f32" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.511802] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.511802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.511802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.512188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.512188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.512368] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.512478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.512549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.512720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.512801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.512891] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c already deleted. [ 776.513480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.536919] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-307" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-307" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-307" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.536919] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.536919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.537923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.538582] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.539642] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.539642] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.539808] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.539882] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.541104] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.541292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.565031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.565031] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.565031] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.565031] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-307" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.565031] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-4b3d171d-20b6-4153-83fb-e0143aee3283 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.565031] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.565031] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.565031] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.565031] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b3d171d-20b6-4153-83fb-e0143aee3283',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.784524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: SUCCESS [ 776.784636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.785153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.785354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.785470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.785530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.785687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.785766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.785848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.785939] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.038755] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2c809a96-2899-48a3-8df0-93bb272164cb None None] Enqueued Resource ID: ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff with Priority: HIGHEST for action port [ 777.040337] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff with Priority: HIGHEST for action port [ 777.040555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.040691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.040809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.041197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.041447] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.068891] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.069218] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.069350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.069625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.069905] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.069905] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 4b3d171d-20b6-4153-83fb-e0143aee3283 not found, creating... [ 777.071261] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.071261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.071261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.071261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.071261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.071608] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.075065] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.075065] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.075065] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.075065] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.075065] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 4b3d171d-20b6-4153-83fb-e0143aee3283 is going to be created. [ 777.096108] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.096263] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.096359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.097045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.097299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.097537] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.289697] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.543793] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff [ 777.545928] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.545928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.545928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.545928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.545928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.545928] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff already deleted. [ 777.545928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef9f0c9c-7c4a-4a63-b6aa-4d01d76ef9ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.791573] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da59ee93-ae54-4a16-87c6-1b9e93ee605e: rpc.has_security_group_logging(os_id): False [ 777.810764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.811026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.811122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.811327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.811424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.811721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.811826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.811889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.812104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.812157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.812213] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e is going to be created. [ 777.875592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.875592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.875755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.875934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.876054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [req-aa496dd9-24bf-49e1-accc-2b741804e56b req-5edfff96-c4f0-41d7-98b0-da177aa09508 service nova] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [req-aa496dd9-24bf-49e1-accc-2b741804e56b req-5edfff96-c4f0-41d7-98b0-da177aa09508 service nova] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [req-aa496dd9-24bf-49e1-accc-2b741804e56b req-5edfff96-c4f0-41d7-98b0-da177aa09508 service nova] Enqueued Resource ID: 4b3d171d-20b6-4153-83fb-e0143aee3283 with Priority: HIGHEST for action port [ 777.891405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: IN_PROGRESS for 2s [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_rules [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 777.891405] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b3d171d-20b6-4153-83fb-e0143aee3283 with Priority: HIGHEST for action port [ 777.891747] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.891747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.891747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.891935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.892028] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.893065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.893209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.895467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.895467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.895467] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.895675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.895675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.895783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.895885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.895949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.896944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b3d171d-20b6-4153-83fb-e0143aee3283 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.896944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.896944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.897405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.897405] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b3d171d-20b6-4153-83fb-e0143aee3283',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.158641] env[65353]: INFO networking_nsxv3.common.synchronization [None req-414c015b-9111-43bb-8320-ddce9730d423 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 778.164027] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 778.164027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.164027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.164027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.164027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.164027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.292582] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4da6db40-329e-4d58-8f94-1c9d69a014a1 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 778.293358] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 778.293618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.294435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.398904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.399127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.399405] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.400482] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b3d171d-20b6-4153-83fb-e0143aee3283 with status ACTIVE [ 778.400693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.400811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.400878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.401086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.401174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.401345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.401440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.401499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.401649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.401726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.401900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.401989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.402263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.402452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.402533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.402637] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b3d171d-20b6-4153-83fb-e0143aee3283 is going to be updated. [ 778.426426] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.426652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.426652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.426834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.426976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.427152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b3d171d-20b6-4153-83fb-e0143aee3283" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.686944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.687252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.687252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.687477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.687628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.687789] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff already deleted. [ 778.687931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.688187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.688428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.688577] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.906179] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.221415] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.221632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.221753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.222061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.222207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.222351] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff already deleted. [ 779.222448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.409542] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.409820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.409820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.410037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.410126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.411495] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c is going to be created. [ 779.443704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.443869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.443928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.444168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.444337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.456196] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: UNINITIALIZED for 2s [ 779.904626] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: SUCCESS [ 779.904626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.164026] env[65353]: INFO networking_nsxv3.common.synchronization [None req-10ec7f75-cc37-44d9-a78e-06b0ba5cfb9e None None] Enqueued Resource ID: e96991af-1c7f-49ac-b642-02e5e281dc16 with Priority: HIGHEST for action port [ 780.164026] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96991af-1c7f-49ac-b642-02e5e281dc16 with Priority: HIGHEST for action port [ 780.165482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e96991af-1c7f-49ac-b642-02e5e281dc16 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.165482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e96991af-1c7f-49ac-b642-02e5e281dc16" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.165482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e96991af-1c7f-49ac-b642-02e5e281dc16" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.166933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e96991af-1c7f-49ac-b642-02e5e281dc16" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.166933] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e96991af-1c7f-49ac-b642-02e5e281dc16',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.667706] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e96991af-1c7f-49ac-b642-02e5e281dc16 [ 780.669211] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.669211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.669211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.669211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.669500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.669500] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e96991af-1c7f-49ac-b642-02e5e281dc16 already deleted. [ 780.669500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e96991af-1c7f-49ac-b642-02e5e281dc16" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.099473] env[65353]: INFO networking_nsxv3.common.synchronization [None req-157b0d82-31b1-4157-8fd5-9446ab4468c4 None None] Enqueued Resource ID: 279a71a7-9ae5-4c5d-aec7-c16e240d3d4a with Priority: HIGHEST for action port [ 781.099739] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 279a71a7-9ae5-4c5d-aec7-c16e240d3d4a with Priority: HIGHEST for action port [ 781.101078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-279a71a7-9ae5-4c5d-aec7-c16e240d3d4a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.101078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-279a71a7-9ae5-4c5d-aec7-c16e240d3d4a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.101078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-279a71a7-9ae5-4c5d-aec7-c16e240d3d4a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.101078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-279a71a7-9ae5-4c5d-aec7-c16e240d3d4a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.101078] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('279a71a7-9ae5-4c5d-aec7-c16e240d3d4a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.469543] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: SUCCESS [ 781.469764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.469987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.470242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.470441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.472018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.472018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.472018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.472018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.472018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.472018] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.604995] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 279a71a7-9ae5-4c5d-aec7-c16e240d3d4a [ 781.605404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.606256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.606743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.609785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.609946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.610205] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:279a71a7-9ae5-4c5d-aec7-c16e240d3d4a already deleted. [ 781.610307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-279a71a7-9ae5-4c5d-aec7-c16e240d3d4a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.953366] env[65353]: INFO networking_nsxv3.common.synchronization [req-486c4065-7848-4196-8c1c-fad53df980dc req-60048f3e-ec21-4d40-b647-29880b39985c tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 781.954430] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 781.955060] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.955188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.955249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.955558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.955734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.955859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.955922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.956110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.956199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.956294] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.977203] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.333371] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.333724] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.333724] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.334106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.334374] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.334522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.334640] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.334846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.334977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.337763] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.337885] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.338130] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.338241] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.338347] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.338446] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.338570] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.361640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.361818] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.361947] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.362136] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.362440] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-e3f422a9-3509-44eb-8192-b0be5b796895 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.362639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.362750] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.363103] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.363246] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f422a9-3509-44eb-8192-b0be5b796895',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.459021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.459451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.459561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.459794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.459890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.460106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.460204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.460294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.460421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.460547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.460749] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e already deleted. [ 782.460888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.481129] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a2987c0-489b-45df-9694-cf09b0682b7c: rpc.has_security_group_logging(os_id): False [ 782.505075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.505075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.505075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.505463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.505463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.505542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c is going to be created. [ 782.569412] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.569624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.569624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.569825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.570018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.581393] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: IN_PROGRESS for 2s [ 782.866114] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.866448] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.866630] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.867051] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.867280] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.867478] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port e3f422a9-3509-44eb-8192-b0be5b796895 not found, creating... [ 782.867873] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.868117] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.868299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.868609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.868836] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.869334] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.869558] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.869756] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.870022] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.870215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.870431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: e3f422a9-3509-44eb-8192-b0be5b796895 is going to be created. [ 782.894690] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.894690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.894690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.894690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.894690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.894690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.621458] env[65353]: INFO networking_nsxv3.common.synchronization [req-486c4065-7848-4196-8c1c-fad53df980dc req-fad1250f-60b2-4919-8189-3d3e5f774526 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 783.624179] env[65353]: INFO networking_nsxv3.common.synchronization [req-486c4065-7848-4196-8c1c-fad53df980dc req-fad1250f-60b2-4919-8189-3d3e5f774526 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 783.624179] env[65353]: INFO networking_nsxv3.common.synchronization [req-486c4065-7848-4196-8c1c-fad53df980dc req-fad1250f-60b2-4919-8189-3d3e5f774526 service nova] Enqueued Resource ID: e3f422a9-3509-44eb-8192-b0be5b796895 with Priority: HIGHEST for action port [ 783.624179] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 783.628039] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 783.628039] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f422a9-3509-44eb-8192-b0be5b796895 with Priority: HIGHEST for action port [ 783.628039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.628039] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.628039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.628039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.628039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.629156] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.632487] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f422a9-3509-44eb-8192-b0be5b796895 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.632737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.632737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.632929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.633020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f422a9-3509-44eb-8192-b0be5b796895',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.864222] env[65353]: INFO networking_nsxv3.common.synchronization [req-d621bca7-be9c-45e1-ac3a-e3ea61e122c1 req-0acdbe18-4e20-4445-90fc-e32bb24e286f tempest-ServerAddressesTestJSON-2051333294 tempest-ServerAddressesTestJSON-2051333294-project-member] Enqueued Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 783.864780] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGHEST for action security_group_members [ 783.867216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.867216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.867216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.867216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.867216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.867750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.867823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.867994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.869756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.869862] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.135469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.135593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.135820] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.137146] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3f422a9-3509-44eb-8192-b0be5b796895 with status ACTIVE [ 784.137353] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.137469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.137552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.137782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.137884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.138153] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.138258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.138317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.138470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.138544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.138761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.138853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.138911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.139065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.139136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.139215] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3f422a9-3509-44eb-8192-b0be5b796895 is going to be updated. [ 784.164267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.167254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.167341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.167761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.168315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.168315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f422a9-3509-44eb-8192-b0be5b796895" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.373603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.375298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.375298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.375298] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 is going to be updated. [ 784.413084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.413084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.413084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.413084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.413084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.421806] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: IN_PROGRESS for 2s [ 784.599200] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: SUCCESS [ 784.599317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.643193] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.148567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.148737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.148787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.148976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.149084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.149193] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be created. [ 785.178282] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.178282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.178282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.179917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.180141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.193640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: UNINITIALIZED for 2s [ 786.435859] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 in Status: SUCCESS [ 786.436341] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 deletion is rescheduled due to dependency. [ 786.436341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.205939] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 787.207036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.207036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.207036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.207036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.207036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.207036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.207334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.207334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.207334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.207413] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.715415] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.715697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.715697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.715915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.716115] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.716230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.716286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.716438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.716575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.718761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.718761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.718761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.718761] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.002967] env[65353]: INFO networking_nsxv3.common.synchronization [req-b6310f09-8e1a-4dda-83e1-2a381440a409 req-83777ef1-b314-44e4-acd6-bb5fbc2bc58a tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 788.003470] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 788.003781] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.003895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.003972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.004628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.004804] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.004898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.005020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.005196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.005287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.005383] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.223977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e: rpc.has_security_group_logging(os_id): False [ 788.247156] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.247289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.247363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.247598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.247704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.248217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.248525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.248566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.248741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.248828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.249042] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.249146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.249205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.249357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.249437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.249612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.249710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.249785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.250507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.250507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.250507] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be created. [ 788.351433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.351588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.351588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.352345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.352345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.366190] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 788.427994] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.428201] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.428318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.428646] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.428903] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.431486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.431486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.431486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.431486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431883] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.431883] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.431883] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.431986] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.432036] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.432604] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.432604] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.489197] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.489197] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.489197] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.489197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.489197] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.489197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.489197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.489197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.489197] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df45cdcb-d09e-4cf8-9b86-0550872fa9ee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.507979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.508211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.508263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.508508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.508646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.509236] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.509236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.509236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.509442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.509442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.509559] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 already deleted. [ 788.509601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.992991] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.993333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.993333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.993522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.994126] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.994126] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port df45cdcb-d09e-4cf8-9b86-0550872fa9ee not found, creating... [ 788.994126] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.994419] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.994419] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.994637] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.996137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.996137] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.996137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.996137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.996137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.996137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.996137] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee is going to be created. [ 789.026319] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.026560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.026679] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.027328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.027328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.027609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.724753] env[65353]: INFO networking_nsxv3.common.synchronization [req-b6310f09-8e1a-4dda-83e1-2a381440a409 req-8486ec55-9a39-419e-9ad2-e2cfa6c19816 service nova] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 789.724753] env[65353]: INFO networking_nsxv3.common.synchronization [req-b6310f09-8e1a-4dda-83e1-2a381440a409 req-8486ec55-9a39-419e-9ad2-e2cfa6c19816 service nova] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 789.724753] env[65353]: INFO networking_nsxv3.common.synchronization [req-b6310f09-8e1a-4dda-83e1-2a381440a409 req-8486ec55-9a39-419e-9ad2-e2cfa6c19816 service nova] Enqueued Resource ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee with Priority: HIGHEST for action port [ 789.724753] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 789.724753] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 789.725190] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee with Priority: HIGHEST for action port [ 789.725190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.725432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.725470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.725714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.725855] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.726843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.726970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.727055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.727266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.727453] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.727539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.727594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.727765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.727869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.727963] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.729897] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.730030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.730101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.730431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.730431] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df45cdcb-d09e-4cf8-9b86-0550872fa9ee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.198800] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 790.198800] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:1 started [ 790.232131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.232341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.233915] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.234922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df45cdcb-d09e-4cf8-9b86-0550872fa9ee with status ACTIVE [ 790.235222] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.235365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.235439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.235732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.235997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.236233] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.236339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.236404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.236725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.236966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.237271] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.237445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.237529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.237752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.237919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.238142] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee is going to be updated. [ 790.263217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.263411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.263579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.263903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.264052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.265035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.386697] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 790.386957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.743148] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.094703] env[65353]: INFO networking_nsxv3.common.synchronization [req-dc5dbdd6-2298-4b0d-8440-9ad7ef57ea6d req-2e5303ae-482d-41c6-93df-e199f4d53160 tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 791.095318] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 791.095623] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.095736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.095799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.096186] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.096559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.096827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.096941] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.246374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.246374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.246374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.246820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.247023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.247125] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be created. [ 791.319708] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.320103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.320103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.321115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.321115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.344365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: UNINITIALIZED for 2s [ 791.598532] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.633597] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.633597] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.633597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.633597] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.633597] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.634371] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.634371] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.634371] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.634371] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.634371] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.658055] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.660035] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.660035] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.660035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.660035] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-7ceddd82-2a57-41b9-b021-b170ca2f6c80 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.660035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.660035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.660035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.660035] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ceddd82-2a57-41b9-b021-b170ca2f6c80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.806311] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d61ff28d-4838-428a-ad5c-8976246aae2c None None] Enqueued Resource ID: 1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5 with Priority: HIGHEST for action port [ 791.806850] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5 with Priority: HIGHEST for action port [ 791.809356] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.809510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.809683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.810259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.810259] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.979401] env[65353]: INFO networking_nsxv3.common.synchronization [None req-7713e6e0-616b-435d-b5e6-66495d856003 tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 791.979839] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 791.980527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.980685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.980767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.981039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.981197] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.097280] env[65353]: INFO networking_nsxv3.common.synchronization [None req-98ffcd70-70e1-4227-bef8-8b32dc807a8b tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 792.097638] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 792.097945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.098187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.101081] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.165114] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.165394] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.165515] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.165800] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.165937] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.166099] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 7ceddd82-2a57-41b9-b021-b170ca2f6c80 not found, creating... [ 792.166364] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.166538] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.166676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.166926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.167097] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.167418] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.168120] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.168120] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.168120] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.168519] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.168987] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 7ceddd82-2a57-41b9-b021-b170ca2f6c80 is going to be created. [ 792.203525] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.203525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.203525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.203525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.203525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.206286] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.314276] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5 [ 792.314799] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.314799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.315077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.315145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.315245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.315349] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5 already deleted. [ 792.315432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cb9ad26-8ca6-4bdc-87ac-80f62c4ef1f5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.504970] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.505220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.505330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.505618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.505754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.505904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f70850f2-6628-4be4-939e-95e5fadec74b already deleted. [ 792.506054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.506286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.506499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.506670] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.604647] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.604647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.604965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.605216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.606802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.606802] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 792.644579] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.644579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.644579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.644579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.644579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.658123] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 792.986892] env[65353]: INFO networking_nsxv3.common.synchronization [req-dc5dbdd6-2298-4b0d-8440-9ad7ef57ea6d req-debfc4a7-d766-456e-9da7-be2340a68f9b service nova] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_rules [ 792.987156] env[65353]: INFO networking_nsxv3.common.synchronization [req-dc5dbdd6-2298-4b0d-8440-9ad7ef57ea6d req-debfc4a7-d766-456e-9da7-be2340a68f9b service nova] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 792.987376] env[65353]: INFO networking_nsxv3.common.synchronization [req-dc5dbdd6-2298-4b0d-8440-9ad7ef57ea6d req-debfc4a7-d766-456e-9da7-be2340a68f9b service nova] Enqueued Resource ID: 7ceddd82-2a57-41b9-b021-b170ca2f6c80 with Priority: HIGHEST for action port [ 792.988403] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_rules [ 792.988403] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 792.990194] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceddd82-2a57-41b9-b021-b170ca2f6c80 with Priority: HIGHEST for action port [ 792.990194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.990194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.990194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.990194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.990194] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.991369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.991582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.992100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ceddd82-2a57-41b9-b021-b170ca2f6c80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.992100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.992100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.992359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.992498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ceddd82-2a57-41b9-b021-b170ca2f6c80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.035508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.035666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.035706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.035918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.036040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.036173] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f70850f2-6628-4be4-939e-95e5fadec74b already deleted. [ 793.036266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.355590] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: SUCCESS [ 793.355987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.356149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.356406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.356656] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.356749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.356785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.356995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.356995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.357121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.357441] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.496967] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497329] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ceddd82-2a57-41b9-b021-b170ca2f6c80 with status ACTIVE [ 793.497504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.498285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499094] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.499094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.499094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.499094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.499094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499094] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.499542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.499542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.499542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.499542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ceddd82-2a57-41b9-b021-b170ca2f6c80 is going to be updated. [ 793.526101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.526395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.526395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.526524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.526592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.526751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ceddd82-2a57-41b9-b021-b170ca2f6c80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.859564] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.041623] env[65353]: INFO networking_nsxv3.common.synchronization [req-d94a8b94-b427-4adc-aa80-1f7dcdd51669 req-338dde1a-4066-4940-935a-5877ea8e2ea3 tempest-ServersNegativeTestJSON-1226471339 tempest-ServersNegativeTestJSON-1226471339-project-member] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 794.042776] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 794.044146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.044146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.044146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.044375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.046286] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.046286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.046286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.046286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.046286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.046286] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.362031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5171ec2a-8acc-4736-a34b-cf763dc5c9f7: rpc.has_security_group_logging(os_id): False [ 794.385148] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.385691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.385816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.386086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.386191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.386438] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.386614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.386614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.386763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.386832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.386920] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be created. [ 794.419853] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.419853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.420133] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.420317] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.420595] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.420809] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.420929] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.421186] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.421339] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.421548] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.421656] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.421752] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.421904] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.421968] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.422086] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.422213] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.425716] env[65353]: INFO networking_nsxv3.common.synchronization [req-d808782f-f985-4235-bd1f-d9d78e651e44 req-e324d1b9-163b-4954-9b73-7e1c01d6dd2d tempest-SecurityGroupRulesNegativeTestJSON-973272506 tempest-SecurityGroupRulesNegativeTestJSON-973272506-project-member] Enqueued Resource ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 with Priority: HIGHEST for action security_group_rules [ 794.426773] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 with Priority: HIGHEST for action security_group_rules [ 794.427456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.427622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.427724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.427994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.428102] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('352f270f-81b3-4ee2-b5d7-c3a42c7c20e7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.446713] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.446969] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.447171] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.447448] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.447872] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.448063] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.448179] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.448540] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.448676] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.469756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.469834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.469884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.470294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.470294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.486836] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: IN_PROGRESS for 2s [ 794.547943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.547943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.547943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.547943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.547943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.548401] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.548401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.548487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.548809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.548809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.548809] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 already deleted. [ 794.550160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.670899] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 794.670899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.670899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.670899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.671039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.671192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.671256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.671458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.672122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.672122] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.785600] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d9cc7fa9-1b20-48d5-aa1f-8926fdd4cec2 None None] Enqueued Resource ID: 510d29f4-0cb4-49f4-ba80-4cfd9b5c583f with Priority: HIGHEST for action port [ 794.787784] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510d29f4-0cb4-49f4-ba80-4cfd9b5c583f with Priority: HIGHEST for action port [ 794.787784] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-510d29f4-0cb4-49f4-ba80-4cfd9b5c583f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.787784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-510d29f4-0cb4-49f4-ba80-4cfd9b5c583f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.787784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-510d29f4-0cb4-49f4-ba80-4cfd9b5c583f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.787784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-510d29f4-0cb4-49f4-ba80-4cfd9b5c583f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.787784] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('510d29f4-0cb4-49f4-ba80-4cfd9b5c583f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.951527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.951527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.951527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.951527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.951527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.951812] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 already deleted. [ 794.951812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.952441] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.952677] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.953168] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.953781] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.953781] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.953920] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 not found, creating... [ 794.954468] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.954468] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.954675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.955018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.955150] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.955476] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.955649] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.955766] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.955990] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.956134] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.956283] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 is going to be created. [ 794.980751] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.980977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.981137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.981442] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.981676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.981895] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.117960] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.118131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.118228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.118473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.118581] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.174221] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.290736] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 510d29f4-0cb4-49f4-ba80-4cfd9b5c583f [ 795.290973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.291663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.291663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.291663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.291663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.291663] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:510d29f4-0cb4-49f4-ba80-4cfd9b5c583f already deleted. [ 795.291977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-510d29f4-0cb4-49f4-ba80-4cfd9b5c583f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.621575] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.676496] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.743242] env[65353]: INFO networking_nsxv3.common.synchronization [req-d94a8b94-b427-4adc-aa80-1f7dcdd51669 req-bc9aa1ee-4a12-4de3-989b-522e29161b7f service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 795.743242] env[65353]: INFO networking_nsxv3.common.synchronization [req-d94a8b94-b427-4adc-aa80-1f7dcdd51669 req-bc9aa1ee-4a12-4de3-989b-522e29161b7f service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 795.743242] env[65353]: INFO networking_nsxv3.common.synchronization [req-d94a8b94-b427-4adc-aa80-1f7dcdd51669 req-bc9aa1ee-4a12-4de3-989b-522e29161b7f service nova] Enqueued Resource ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with Priority: HIGHEST for action port [ 795.744996] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 795.748031] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 795.748031] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with Priority: HIGHEST for action port [ 795.748031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.748031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.748031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.748031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.748031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.748544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.748544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.748544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.748653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.748876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.748876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.748876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.751035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.751035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.751035] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.751035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.751319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.751319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.751539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.751667] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.782724] env[65353]: INFO networking_nsxv3.common.synchronization [req-c5a83442-4c0f-439a-9829-381c427544b5 req-0545f3e2-1c1a-4cab-a1b3-8da3d2e9a127 tempest-SecurityGroupRulesNegativeTestJSON-973272506 tempest-SecurityGroupRulesNegativeTestJSON-973272506-project-member] Enqueued Resource ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 with Priority: HIGHEST for action security_group_rules [ 795.783301] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 with Priority: HIGHEST for action security_group_rules [ 795.787147] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.787147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.787147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.787147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.787147] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('352f270f-81b3-4ee2-b5d7-c3a42c7c20e7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.126831] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.179957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.179957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.179957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.179957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.179957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.180158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 796.213904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.214112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.214180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.214389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.214534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.226249] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 796.254349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.254349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.254633] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.256839] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with status ACTIVE [ 796.257113] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.257284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.257394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.257985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.257985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.258170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.258231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.258283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.259051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.259051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.259051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.259051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.259328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.259328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.259428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.259756] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 is going to be updated. [ 796.290920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.290920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.290920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.291906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.291906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.291906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.337198] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.337344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.337413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.337623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.340410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.340410] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 352f270f-81b3-4ee2-b5d7-c3a42c7c20e7 already deleted. [ 796.340410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-352f270f-81b3-4ee2-b5d7-c3a42c7c20e7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.504522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: SUCCESS [ 796.504814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.629357] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 796.629916] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 796.758020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.260719] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.260904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.260985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.261277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.261365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.261465] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be created. [ 797.291012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.291239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.291321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.291528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.291697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.302442] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: UNINITIALIZED for 2s [ 797.484020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.484197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.484272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.484510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.499223] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 797.500225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.501677] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 797.536309] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.536309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.536309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.536309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.543987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.544573] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 797.544654] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.544743] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 797.587571] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.587859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.588194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.588194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.589729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.590369] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 797.681761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.682374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.682374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.682374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.682525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.682688] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 797.759714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.759714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.759714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.760010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.760974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.761399] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 797.761518] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'45dfa09f-d33f-4e30-90a3-f513b6ee3d71', 'fc6d712f-e111-4ee3-8ed1-729c0a27074b', '77899b4e-41ba-45bf-ac89-22e780314f5f', 'a9e4cc2e-7db9-4ecb-adb0-1ff58af51797', '752918e1-1064-471b-80a5-ab7d9c9b7427', '97a6a2db-7d02-4b39-8d52-74d0e645bfea', 'e97e4458-7809-406b-8b2f-b7ee556500c1', '82ad068a-08bf-42b7-b52d-4ee5bd2c752e', '0b59c8a2-e271-42d7-9144-e62c90117e8b', 'f3431123-e3cf-4858-b3b8-2bcd1acc45c7', '8d5e265c-8dcf-4ba9-992c-3e96278d6735', '0678802a-91aa-46fa-8b87-44cd93c89d75', 'ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462', '48b0c35b-0d23-4bce-9d0f-06d04bbceb0e', '27ce0226-fe63-4c32-b41f-c2e799ff5d0a', '576f0f86-448d-4fa9-9110-1b5ac65e3d65', '9504e678-5653-4fec-9797-d96edd9ac6e9', '364b11fe-318c-46b4-aed3-75bf7424303b', 'a50e19b0-6d35-4446-a201-3a0ffc40db91', 'da59ee93-ae54-4a16-87c6-1b9e93ee605e', '5171ec2a-8acc-4736-a34b-cf763dc5c9f7', 'c2f635c3-4601-4155-b8e5-e2dab677e518', 'eef90e1f-f512-4c74-82f2-c918b64f5aee', '1a2987c0-489b-45df-9694-cf09b0682b7c', 'cadcc6df-baac-43fd-bf48-5485c0b69d95', '101d7123-33df-4206-98ea-c31321fdee80', 'e0209ced-141c-4ff9-b95c-1f2fc770b1f0', 'fcebdf84-f874-4db4-b283-bda9c57166cf', '0bceb08f-d9a1-4677-8b2e-0aeacfbbb531', '187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5', 'e9cb80b2-00dd-48f3-aba0-08eecbed0594'} {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.761518] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 797.786345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.786345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.786345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.786345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.786345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.786345] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 797.786345] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.786345] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 797.890169] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.890169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.890169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.890169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.890169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.890169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 797.890169] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.890169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 797.890169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 797.890169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGH for action security_group_rules [ 797.890169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGH for action security_group_rules [ 797.891575] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGH for action security_group_rules [ 797.891575] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGH for action security_group_rules [ 797.891575] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGH for action security_group_rules [ 797.891575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.054717] env[65353]: INFO networking_nsxv3.common.synchronization [req-2feb1b9a-b8a8-4d6f-8c56-246d26986697 req-8bf45627-a9ae-40d7-8504-836f8bd8d563 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 798.056013] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 798.056218] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 with Priority: HIGH for action security_group_rules [ 798.056425] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGH for action security_group_rules [ 798.056592] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGH for action security_group_rules [ 798.056705] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a with Priority: HIGH for action security_group_rules [ 798.056804] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGH for action security_group_rules [ 798.056928] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 with Priority: HIGH for action security_group_rules [ 798.057226] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364b11fe-318c-46b4-aed3-75bf7424303b with Priority: HIGH for action security_group_rules [ 798.057411] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 with Priority: HIGH for action security_group_rules [ 798.057519] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGH for action security_group_rules [ 798.057614] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGH for action security_group_rules [ 798.057708] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 with Priority: HIGH for action security_group_rules [ 798.057861] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 with Priority: HIGH for action security_group_rules [ 798.057979] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGH for action security_group_rules [ 798.058163] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 with Priority: HIGH for action security_group_rules [ 798.058296] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 798.058382] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGH for action security_group_rules [ 798.058478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e with Priority: HIGH for action security_group_rules [ 798.058603] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGH for action security_group_rules [ 798.058773] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGH for action security_group_rules [ 798.058935] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 798.059273] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.059420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.059521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.060053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.060343] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.060499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.060588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.060759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.060905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.061094] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.062209] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.062379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.062490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.062721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.062820] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45dfa09f-d33f-4e30-90a3-f513b6ee3d71',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.064165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.064297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.064496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.064661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.064741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.065020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.065171] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.065977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.066212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.066546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.066546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.066546] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27ce0226-fe63-4c32-b41f-c2e799ff5d0a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.067849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.068044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.068119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068355] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.069508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a50e19b0-6d35-4446-a201-3a0ffc40db91 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.069657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.069785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.070009] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.070237] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a50e19b0-6d35-4446-a201-3a0ffc40db91',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.071438] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364b11fe-318c-46b4-aed3-75bf7424303b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.071580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.071652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.071807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.071945] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364b11fe-318c-46b4-aed3-75bf7424303b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.072998] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9504e678-5653-4fec-9797-d96edd9ac6e9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.073163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.073231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.073383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.073484] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9504e678-5653-4fec-9797-d96edd9ac6e9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.074621] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.074731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.074798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.074989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.075184] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.077059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.077059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.077156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.077245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.077495] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.078578] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.078716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.078747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.078923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.079031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.079391] env[65353]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 798.080239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0678802a-91aa-46fa-8b87-44cd93c89d75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.080414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.080525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.080805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.080805] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0678802a-91aa-46fa-8b87-44cd93c89d75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.082313] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.082429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.082540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.082802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.082892] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.083938] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.084077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.084209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.084463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.084548] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3431123-e3cf-4858-b3b8-2bcd1acc45c7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.085533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.085659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.085774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.086007] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.086104] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.087611] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.087611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.087611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.087723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.087723] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.088802] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.090800] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82ad068a-08bf-42b7-b52d-4ee5bd2c752e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.090800] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.090800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.090800] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.094697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.094697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.094697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.094697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.094697] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.095754] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.095914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.096031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.096249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.096314] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.101149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.101302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.105020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.105020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.105020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.105607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.105644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.105834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.105959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.106081] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.138588] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.138588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.143398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.143670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.143803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.143872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.144125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.144226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.144318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 798.148710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.151130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.181129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.181363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45dfa09f-d33f-4e30-90a3-f513b6ee3d71 is going to be deleted. [ 798.189703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.194096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.194096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.194096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.194096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.202426] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 798.237292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 798.237573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.238407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.238781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.238960] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.239139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.239216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.239618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.239618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.239731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.239873] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.253478] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.254117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.254327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.257174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45dfa09f-d33f-4e30-90a3-f513b6ee3d71" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.617106] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.652294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.653321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.653321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.653409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.653603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.653984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.653984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.654607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.654607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.654607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.654742] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.657072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.660019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.660019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.660019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.663671] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.663935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.664063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.664983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.664983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.665130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.665244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.666874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.666874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.666874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.666874] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.668620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.668620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.672212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.672212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.672212] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.673441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.673441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.673441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.674517] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.676849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.676849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.677016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.677062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.677259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.677383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.677466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.677660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.677739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.677860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.678055] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.683191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.683191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.683191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.683191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.683191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.683191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.683191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.683806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.683806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.683806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.683806] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.685135] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.685518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.685592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.685916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.686765] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.686765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.686765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.687074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.687074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.687074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.687074] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.694508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.694508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.694508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.694508] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.742979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.743169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.743304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.743487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.743657] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.743769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.743827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.744056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.744162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.744237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.744405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.744509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.744622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.744849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.745048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.745221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.745401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.745712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.745859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.747298] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.748088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.748214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.748287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.748454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.755669] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.755867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.758087] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.758087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.758850] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.758964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.760811] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.761526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.762836] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.762999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.764155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.764246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.765253] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.765663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.767325] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77899b4e-41ba-45bf-ac89-22e780314f5f: rpc.has_security_group_logging(os_id): False [ 798.791544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.791764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.794876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.795050] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9504e678-5653-4fec-9797-d96edd9ac6e9 is going to be deleted. [ 798.797215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.797564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.827872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.830212] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82ad068a-08bf-42b7-b52d-4ee5bd2c752e is going to be deleted. [ 798.830212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.830697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.873071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.873071] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a50e19b0-6d35-4446-a201-3a0ffc40db91 is going to be deleted. [ 798.873954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.874238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.920785] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.920893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.926079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.926234] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462 is going to be deleted. [ 798.928351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.928619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.932030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.932149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.966793] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.967061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.971763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.971763] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0678802a-91aa-46fa-8b87-44cd93c89d75 is going to be deleted. [ 798.976056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.976499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.020027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.020027] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27ce0226-fe63-4c32-b41f-c2e799ff5d0a is going to be deleted. [ 799.020027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.020027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.083979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.084175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.107804] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.107804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.108962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.109123] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3431123-e3cf-4858-b3b8-2bcd1acc45c7 is going to be deleted. [ 799.110188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.110478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.121923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e97e4458-7809-406b-8b2f-b7ee556500c1: rpc.has_security_group_logging(os_id): False [ 799.162602] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.162830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.162909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.163258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.163349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.163429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.163429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.164749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.164749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.164749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.164749] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.165036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.165036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.165151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.166132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.166132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.166132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.166132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.166132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.166132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.166132] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.168879] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.168879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.172937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.172937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364b11fe-318c-46b4-aed3-75bf7424303b is going to be deleted. [ 799.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.174062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.200364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.200523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.201118] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.201118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.201118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.201340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.201531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.201832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.201832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.201953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.202091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.202258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.202355] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.202661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.202661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.202803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.203443] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.203443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.203443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.203443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.203443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.203443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.203789] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.204745] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.204891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.204948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.205091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.205267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.205401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.205473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.205643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.205729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.205828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.206064] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.206146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.206195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.206346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.206510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.207040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.207040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.207040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.207040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.207040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.207302] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.208943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.209173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.209173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.209370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.209524] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.210288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.210288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.210982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.210982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.210982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.210982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.210982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.211163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.211263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.211297] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.212683] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.212683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.212683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.212915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.213048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.213169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.213241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.213483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.213671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.215029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.215029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.215029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.215029] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.215886] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.216732] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.216840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.216877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.217083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.217242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.217341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.217404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.217550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.217631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.217714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.217862] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.217952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.218031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.218158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.218294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.218396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.218507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.218655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.218733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.218814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.218900] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.219738] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.220659] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.221914] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 576f0f86-448d-4fa9-9110-1b5ac65e3d65: rpc.has_security_group_logging(os_id): False [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.225471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.225471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.225471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.225962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.225962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.225962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.225962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.225962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.226208] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 799.228480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.228666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.228756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.228879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9504e678-5653-4fec-9797-d96edd9ac6e9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.229047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.229171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.229256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.229356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82ad068a-08bf-42b7-b52d-4ee5bd2c752e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.230124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.230311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.230392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.230701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a50e19b0-6d35-4446-a201-3a0ffc40db91" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.230701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.230830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.230911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.231035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1ecfc5-c6e4-4ae4-ab00-aa5e34f87462" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.231936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.232113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.232196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.232312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0678802a-91aa-46fa-8b87-44cd93c89d75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.232432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.232575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.404857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.405104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.410163] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 799.410500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.410961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.411518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.411518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.411700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.411794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.412024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.412193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.412395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.412550] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.416092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.416460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.416577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.416624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.416867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.416983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.417121] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 is going to be updated. [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27ce0226-fe63-4c32-b41f-c2e799ff5d0a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.419644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.457093] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.457093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.457654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.457654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.466920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.467237] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.467391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.467532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.467898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.467898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.468063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.468148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.468199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.468352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.468470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.468596] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.468698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.468765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.468961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.469065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.469666] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 799.470880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.471095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.471198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.471399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364b11fe-318c-46b4-aed3-75bf7424303b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.471843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.472201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.472312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.472454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3431123-e3cf-4858-b3b8-2bcd1acc45c7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.503513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.503696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.503840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.505557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.505557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.547922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 799.553965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.554225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.554349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.554685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.554936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.575443] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: IN_PROGRESS for 2s [ 799.639082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.639082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.639082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.639082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.639082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.657537] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 799.669171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 799.696452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.696916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.696916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.696916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.724413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b59c8a2-e271-42d7-9144-e62c90117e8b: rpc.has_security_group_logging(os_id): False [ 799.725749] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e: rpc.has_security_group_logging(os_id): False [ 799.726800] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 752918e1-1064-471b-80a5-ab7d9c9b7427: rpc.has_security_group_logging(os_id): False [ 799.727834] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da59ee93-ae54-4a16-87c6-1b9e93ee605e: rpc.has_security_group_logging(os_id): False [ 799.728886] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e4cc2e-7db9-4ecb-adb0-1ff58af51797: rpc.has_security_group_logging(os_id): False [ 799.730041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5e265c-8dcf-4ba9-992c-3e96278d6735: rpc.has_security_group_logging(os_id): False [ 799.731908] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc6d712f-e111-4ee3-8ed1-729c0a27074b: rpc.has_security_group_logging(os_id): False [ 799.780848] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.787113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.787113] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.787113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.787113] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.787113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.787113] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.787113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.792688] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.792688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.797024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.797024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.797024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.797024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.797674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.797674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.797674] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 799.798963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.799408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.802265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.802923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.804276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.804839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.838033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.838033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.838033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.839509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.839864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.840129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.840493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.840676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.840911] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 799.842329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.843020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.871364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.871364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.871364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.871364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.871903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.871903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.871903] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 799.873321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.873676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.884856] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.885256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.898470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.898790] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.899857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.899857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.900238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.900238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.900238] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.900238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.900422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.900598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.900598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.900716] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 799.902079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.902400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916950] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916950] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.916950] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.917526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.917526] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.917526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.917526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.917526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.917526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.917742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.917742] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.921165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.921369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.927416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.929103] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.929103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.929103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.929103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.929103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.929103] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 799.930526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.930526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.967593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.969128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.969128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.969128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.969128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.969128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.973433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.973433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.973433] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 is going to be updated. [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.973433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.973843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.973936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.021596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 800.030826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.031033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.040288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.040814] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.040998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.041148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.041385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.041473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.041937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e is going to be updated. [ 800.044670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.044985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.047606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.047767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.072146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.072410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.099286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.099614] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.099720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.101201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.101201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.101201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.101201] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be updated. [ 800.103413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.103925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.103925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.109917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.111400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.111514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.111640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.149110] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 800.150389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.150678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.150770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.151143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.151316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.154057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 800.158955] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 800.160374] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 800.194089] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: IN_PROGRESS for 2s [ 800.215189] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 800.215410] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 800.215529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.258382] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.258593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.258593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.258814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.259055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.275494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.275718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.275826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.276183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.276409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.281405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: IN_PROGRESS for 2s [ 800.312264] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: IN_PROGRESS for 2s [ 800.426042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28dd6d0-e311-4f5d-a6ed-59453af2dcc0: rpc.has_security_group_logging(os_id): False [ 800.447118] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.447118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.447118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.447590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.447842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.448606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.448901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.449070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.449461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.449671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.450045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451153] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451763] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be created. [ 800.515339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.515599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.515718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.515963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.516208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.530594] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 800.885341] env[65353]: INFO networking_nsxv3.common.synchronization [req-03a2662b-943b-4b02-b107-315548a76631 req-3530d55f-6fea-45ca-881b-78929311ecfc tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 800.885885] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 800.886482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.886643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.886774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.886863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.887034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.887170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.887170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.887327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.887409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.887504] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.390443] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.572591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 801.575949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.575949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.575949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.575949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.604777] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: SUCCESS [ 801.605020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.676712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 801.677039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.896622] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.036561] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 802.036900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.084369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.084513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.084580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.084790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.084943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.085050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.085111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.085265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.085326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.085410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.085496] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.164821] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 802.165174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.166624] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 802.166856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.177050] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 802.177610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.179018] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 802.179018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.206392] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: SUCCESS [ 802.206658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.297572] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: SUCCESS [ 802.297806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.325304] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: SUCCESS [ 802.325536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.399917] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.400328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.400328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.401456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.401456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.401456] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 802.433089] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.433089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.433089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.433089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.433089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.443114] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 802.546408] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 802.546770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.590612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.590612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.590612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.591315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.591315] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.591315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.591315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.591315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.591565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.591565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.591677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.592071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.592071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.592071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.592071] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.818287] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e6b7d5c2-19c1-4b8f-a7a8-890f9b9bd454 None None] Enqueued Resource ID: 90c002c8-46bd-492c-be7d-f9f2caf2f4f4 with Priority: HIGHEST for action port [ 802.818834] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c002c8-46bd-492c-be7d-f9f2caf2f4f4 with Priority: HIGHEST for action port [ 802.819216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-90c002c8-46bd-492c-be7d-f9f2caf2f4f4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.819441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90c002c8-46bd-492c-be7d-f9f2caf2f4f4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.819441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90c002c8-46bd-492c-be7d-f9f2caf2f4f4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.819649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90c002c8-46bd-492c-be7d-f9f2caf2f4f4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.819726] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90c002c8-46bd-492c-be7d-f9f2caf2f4f4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.094262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77899b4e-41ba-45bf-ac89-22e780314f5f: rpc.has_security_group_logging(os_id): False [ 803.119051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.119051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.119051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.119051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.123298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.123467] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.123547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.123608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.123768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.123927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.124106] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 803.190929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.191721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.191721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.191721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.191721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.207383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 803.322157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90c002c8-46bd-492c-be7d-f9f2caf2f4f4 [ 803.327204] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.327204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.327204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.327204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.327204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.327204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90c002c8-46bd-492c-be7d-f9f2caf2f4f4 already deleted. [ 803.327204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90c002c8-46bd-492c-be7d-f9f2caf2f4f4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.525882] env[65353]: INFO networking_nsxv3.common.synchronization [req-9f532871-0ecb-48a6-9c77-c3a6f40d0d3b req-a1b98862-2b44-4d61-bd97-8bac80d18d26 tempest-ServerGroupTestJSON-77265041 tempest-ServerGroupTestJSON-77265041-project-member] Enqueued Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 803.527391] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 803.527391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.527571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.527571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.527816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.527963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.528070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.528123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.528279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.528364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.528456] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.721025] env[65353]: INFO networking_nsxv3.common.synchronization [None req-39823bc4-b1e8-482d-a301-0026a1be7147 tempest-ServersV294TestFqdnHostnames-598803872 tempest-ServersV294TestFqdnHostnames-598803872-project-member] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 803.724962] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 803.724962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.724962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.724962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.724962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.724962] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.031050] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.031050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.031050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.031050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.031050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.031261] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.031261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.031340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.031502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.031608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.031652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae already deleted. [ 804.031734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.046188] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.046633] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-175" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.046633] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-175" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.046812] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-175" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.047118] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.047387] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.047510] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.047725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.047868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.048163] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.048363] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.048552] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.048686] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.048806] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.048903] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.049045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.068782] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.069033] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.069173] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.069347] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-175" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.070276] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.070276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.070276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.070276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.070618] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9bc6a0-4c98-4d4d-a846-6891e371c99e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.218233] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a66756b7-4c2e-4883-9673-1b90ad8ca8bd tempest-ServersV294TestFqdnHostnames-598803872 tempest-ServersV294TestFqdnHostnames-598803872-project-member] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 804.218751] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 804.219482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.219482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.247957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.247957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.247957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.247957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.247957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.247957] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 already deleted. [ 804.247957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.248326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.248458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.248514] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.454158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 804.454383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.572657] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.572951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.574076] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.574316] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.574629] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.574909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 5b9bc6a0-4c98-4d4d-a846-6891e371c99e not found, creating... [ 804.575252] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.575423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.575537] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.575795] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.575893] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.576220] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.576401] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.576526] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.576805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.576947] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.577107] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 5b9bc6a0-4c98-4d4d-a846-6891e371c99e is going to be created. [ 804.599395] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.599593] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.600012] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.600385] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.600621] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.600843] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.676890] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e1f5ec17-bd83-45bd-b863-cc1706ee2b89 None None] Enqueued Resource ID: 7b9c74ec-e83b-4e26-b270-66cd9bbb8d18 with Priority: HIGHEST for action port [ 804.676890] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b9c74ec-e83b-4e26-b270-66cd9bbb8d18 with Priority: HIGHEST for action port [ 804.676890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b9c74ec-e83b-4e26-b270-66cd9bbb8d18 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.676890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b9c74ec-e83b-4e26-b270-66cd9bbb8d18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.676890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b9c74ec-e83b-4e26-b270-66cd9bbb8d18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.677195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b9c74ec-e83b-4e26-b270-66cd9bbb8d18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.677270] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b9c74ec-e83b-4e26-b270-66cd9bbb8d18',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.770509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.770679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.770679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.770985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.771100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.771217] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 already deleted. [ 804.771288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.180413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b9c74ec-e83b-4e26-b270-66cd9bbb8d18 [ 805.181529] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.181674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.181741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.181961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.182073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.182174] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b9c74ec-e83b-4e26-b270-66cd9bbb8d18 already deleted. [ 805.182255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b9c74ec-e83b-4e26-b270-66cd9bbb8d18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.221378] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 805.221706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.327627] env[65353]: INFO networking_nsxv3.common.synchronization [req-9f532871-0ecb-48a6-9c77-c3a6f40d0d3b req-5cb66695-060b-4790-bfaf-69c510a67f6b service nova] Enqueued Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_rules [ 805.327627] env[65353]: INFO networking_nsxv3.common.synchronization [req-9f532871-0ecb-48a6-9c77-c3a6f40d0d3b req-5cb66695-060b-4790-bfaf-69c510a67f6b service nova] Enqueued Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 805.328705] env[65353]: INFO networking_nsxv3.common.synchronization [req-9f532871-0ecb-48a6-9c77-c3a6f40d0d3b req-5cb66695-060b-4790-bfaf-69c510a67f6b service nova] Enqueued Resource ID: 5b9bc6a0-4c98-4d4d-a846-6891e371c99e with Priority: HIGHEST for action port [ 805.332620] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_rules [ 805.332620] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 805.332620] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9bc6a0-4c98-4d4d-a846-6891e371c99e with Priority: HIGHEST for action port [ 805.332620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.332620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.332620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.332620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.332620] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.333519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.334121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.334121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.334121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.334868] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.335158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.336754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.336754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.336754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.336754] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.338262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.338262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.338262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.338262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.338262] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9bc6a0-4c98-4d4d-a846-6891e371c99e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.840635] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.841708] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.841826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.844905] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b9bc6a0-4c98-4d4d-a846-6891e371c99e with status ACTIVE [ 805.844905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.844905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.844905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.844905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.844905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.844905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.845211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.845211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.845211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.845292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.845452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.845513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.845597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.845728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.845757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.845869] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b9bc6a0-4c98-4d4d-a846-6891e371c99e is going to be updated. [ 805.870279] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.870279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.870279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.870279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.870279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.870279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b9bc6a0-4c98-4d4d-a846-6891e371c99e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.343933] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.583022] env[65353]: INFO networking_nsxv3.common.synchronization [None req-98bbcde5-5671-4bf4-b03d-78e48de41f40 None None] Enqueued Resource ID: 1da6910f-2301-4392-880f-f63a8e5645e8 with Priority: HIGHEST for action port [ 806.583022] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da6910f-2301-4392-880f-f63a8e5645e8 with Priority: HIGHEST for action port [ 806.583613] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da6910f-2301-4392-880f-f63a8e5645e8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.583686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da6910f-2301-4392-880f-f63a8e5645e8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.583962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da6910f-2301-4392-880f-f63a8e5645e8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.584168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da6910f-2301-4392-880f-f63a8e5645e8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.584249] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da6910f-2301-4392-880f-f63a8e5645e8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.851065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.851065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.851065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.851263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.851368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.851820] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae is going to be created. [ 806.885539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.885539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.885539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.885539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.885539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.924131] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: UNINITIALIZED for 2s [ 807.086913] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1da6910f-2301-4392-880f-f63a8e5645e8 [ 807.086913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.087124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.087124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.087303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.087388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.087545] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1da6910f-2301-4392-880f-f63a8e5645e8 already deleted. [ 807.087608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da6910f-2301-4392-880f-f63a8e5645e8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.142049] env[65353]: INFO networking_nsxv3.common.synchronization [None req-8b7975dd-4318-411f-b969-1971729f642d None None] Enqueued Resource ID: dc5b11d3-3c63-4852-af50-0cc40128ac3c with Priority: HIGHEST for action port [ 807.142049] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5b11d3-3c63-4852-af50-0cc40128ac3c with Priority: HIGHEST for action port [ 807.142049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5b11d3-3c63-4852-af50-0cc40128ac3c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.142049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5b11d3-3c63-4852-af50-0cc40128ac3c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.142049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5b11d3-3c63-4852-af50-0cc40128ac3c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.142835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5b11d3-3c63-4852-af50-0cc40128ac3c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.142835] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5b11d3-3c63-4852-af50-0cc40128ac3c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.569158] env[65353]: INFO networking_nsxv3.common.synchronization [req-f75cd7b4-ecbf-4099-951d-430b23f29b07 req-72989d39-3db3-4ddc-84c7-79982c6cdf97 tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 807.570274] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 807.570604] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.570815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.570886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.571145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.571304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.571431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.571483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.571611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.571697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.571788] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.644464] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc5b11d3-3c63-4852-af50-0cc40128ac3c [ 807.644982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.645192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.645264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.645479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.645568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc5b11d3-3c63-4852-af50-0cc40128ac3c already deleted. [ 807.645923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5b11d3-3c63-4852-af50-0cc40128ac3c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.885524] env[65353]: INFO networking_nsxv3.common.synchronization [req-cf79d9bd-8a86-4ec8-95bf-b287e5d6ee98 req-d59fbd5e-0d60-4159-991d-0080dabb73ab tempest-ListImageFiltersTestJSON-1125268538 tempest-ListImageFiltersTestJSON-1125268538-project-member] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 807.886511] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 807.887055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.887376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.890442] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.890442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.890442] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.024144] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.024376] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.027969] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.027969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.027969] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.027969] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.027969] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.027969] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.027969] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.027969] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.027969] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.046199] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.046504] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.046659] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.046904] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.047199] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.047871] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.047871] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.047871] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.048165] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.074116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.074267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.074338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.074539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.074625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.074811] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.074912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.075061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.075131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.075367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.075472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 already deleted. [ 808.075566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.394069] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.552151] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.552409] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.552529] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.554061] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 not found, creating... [ 808.554061] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.554061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.554854] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.554854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.554854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.554854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.554854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.555278] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 is going to be created. [ 808.584960] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.585318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.585318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.585500] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.585727] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.585943] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.897553] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.936029] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: SUCCESS [ 808.936029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.936225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.936400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.936629] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.936772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.936876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.937168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.937168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.937266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.937319] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.381063] env[65353]: INFO networking_nsxv3.common.synchronization [req-f75cd7b4-ecbf-4099-951d-430b23f29b07 req-a01c91fc-da49-4e87-8bfc-2d424d7a8145 service nova] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 809.381063] env[65353]: INFO networking_nsxv3.common.synchronization [req-f75cd7b4-ecbf-4099-951d-430b23f29b07 req-a01c91fc-da49-4e87-8bfc-2d424d7a8145 service nova] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 809.381272] env[65353]: INFO networking_nsxv3.common.synchronization [req-f75cd7b4-ecbf-4099-951d-430b23f29b07 req-a01c91fc-da49-4e87-8bfc-2d424d7a8145 service nova] Enqueued Resource ID: e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 with Priority: HIGHEST for action port [ 809.381994] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 809.384643] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 809.384828] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 with Priority: HIGHEST for action port [ 809.385266] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.385351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.385428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.385662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.385746] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.390598] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.390781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.390892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.391303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.391303] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.391389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.391460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.391813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.391913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.392060] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.394120] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.394120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.394120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.394273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.394346] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.400164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.400392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.400392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.400600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.404024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.404024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 809.440433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.440433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.441123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.441379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.441619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.446031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.446525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.447413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.447413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.447413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.447413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.447413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.447413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.449109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.449109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.449109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.449109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.449109] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.461355] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 809.899158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.899158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.899501] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.901229] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 with status ACTIVE [ 809.901513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.901762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.901893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.902345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.902529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.902781] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.902967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.903106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.903321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.903448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.903734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.903894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.904032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.904277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.904399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.904525] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7 is going to be updated. [ 809.930841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.931246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.931328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.931518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.931671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.933275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c4c1e6-3ca7-4c41-8ab9-d0ba790277d7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.952126] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3469e958-4a31-4f2a-987e-042bbed3a4ae: rpc.has_security_group_logging(os_id): False [ 809.979344] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.979583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.979583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.979778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.979853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.980374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.980374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.980374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.980374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.980641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.980641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.980724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.980780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.980920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.980988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.981208] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.981303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.981343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.981602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.981602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.981602] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae is going to be created. [ 810.070304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.071109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.071109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.071109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.071400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.087571] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: IN_PROGRESS for 2s [ 810.219197] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ac1f2cb-1164-4a06-b5cd-557363a3909c req-8603f886-d1c7-48d4-8d9d-156ebf8acb82 tempest-ImagesOneServerTestJSON-1100482761 tempest-ImagesOneServerTestJSON-1100482761-project-member] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 810.219197] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGHEST for action security_group_members [ 810.219560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.219688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.219756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.219968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.221963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.222106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.222187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.222388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.222492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.222596] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.408274] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.726014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.726674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.727069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.727069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.727069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.727275] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.727373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.728307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.729337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.729337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.729337] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 is going to be updated. [ 810.779830] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.780087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.780087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.781059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.781059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.792597] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: IN_PROGRESS for 2s [ 810.911171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.911713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.911713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.911713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.911937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.911937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be created. [ 810.942179] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.942356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.942433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.942584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.942751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.955832] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: UNINITIALIZED for 2s [ 811.480360] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 811.480591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.101523] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: SUCCESS [ 812.101523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.804670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 in Status: SUCCESS [ 812.804863] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 deletion is rescheduled due to dependency. [ 812.805115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.967361] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 812.967575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.967800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.968091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.968290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.968406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.968507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.968664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.968745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.968827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.968927] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.472244] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.748603] env[65353]: INFO networking_nsxv3.common.synchronization [req-071381fc-18f6-47ba-a9c3-aecf2bc3979a req-c48db267-5ebe-4dea-aae0-1e60a2792e39 tempest-ImagesNegativeTestJSON-718148462 tempest-ImagesNegativeTestJSON-718148462-project-member] Enqueued Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 813.752146] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 813.752667] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.752840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.752937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.753328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.753514] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.753651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.753753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.753984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.754125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.754266] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.979751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 400ed73f-78cb-4aac-8a3b-e0415f1fbf19: rpc.has_security_group_logging(os_id): False [ 813.999444] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.999583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.999647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.000482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.000482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.000482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.000482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.000482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.000752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.000752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.000806] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be created. [ 814.088278] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.089100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.089100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.089100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.089268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.107020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 814.162122] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.162331] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-689" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.162616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-689" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.162798] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-689" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.165482] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.165704] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.165827] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.166099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.166253] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.166544] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.166693] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.166833] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.166945] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.167068] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.167172] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.167301] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.195039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.195414] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.195587] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.195805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-689" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.196938] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.197250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.197447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.197910] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.198162] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc357d9-7c3f-40e9-8d03-6a9dfef89fe6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.265051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.265898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.265898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.265898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.265898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.265898] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.266188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.266188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.266188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.266289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.266320] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc8572-c14a-4402-8307-015f5348ce03 already deleted. [ 814.266668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.700713] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.701829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.701829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.701829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.701829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.701829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 not found, creating... [ 814.702083] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.702162] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.702393] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.702458] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.702559] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.703229] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.703229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.703229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.703509] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.703675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.703814] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 is going to be created. [ 814.726261] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.728639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.728639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.728639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.728639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.728639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.136065] env[65353]: INFO networking_nsxv3.common.synchronization [None req-54df97fd-47f9-4029-9858-30687bd5b7ed None None] Enqueued Resource ID: e88f5716-5f3a-4d3a-88ec-31a31cb322f3 with Priority: HIGHEST for action port [ 815.136584] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f5716-5f3a-4d3a-88ec-31a31cb322f3 with Priority: HIGHEST for action port [ 815.136893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e88f5716-5f3a-4d3a-88ec-31a31cb322f3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.137023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e88f5716-5f3a-4d3a-88ec-31a31cb322f3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.137091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e88f5716-5f3a-4d3a-88ec-31a31cb322f3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.137342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e88f5716-5f3a-4d3a-88ec-31a31cb322f3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.137426] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e88f5716-5f3a-4d3a-88ec-31a31cb322f3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.428417] env[65353]: INFO networking_nsxv3.common.synchronization [req-071381fc-18f6-47ba-a9c3-aecf2bc3979a req-a68a6c70-09cc-4b31-93ce-eb9886b955bb service nova] Enqueued Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_rules [ 815.428417] env[65353]: INFO networking_nsxv3.common.synchronization [req-071381fc-18f6-47ba-a9c3-aecf2bc3979a req-a68a6c70-09cc-4b31-93ce-eb9886b955bb service nova] Enqueued Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 815.428417] env[65353]: INFO networking_nsxv3.common.synchronization [req-071381fc-18f6-47ba-a9c3-aecf2bc3979a req-a68a6c70-09cc-4b31-93ce-eb9886b955bb service nova] Enqueued Resource ID: abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 with Priority: HIGHEST for action port [ 815.428789] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_rules [ 815.428928] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 815.429387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 with Priority: HIGHEST for action port [ 815.429864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.430051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.430179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.430493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.430641] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.432779] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.433067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.433434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.433434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.433732] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.433918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.434337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.434337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.434337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.434539] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.435463] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.435907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.437215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.437215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.437215] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc357d9-7c3f-40e9-8d03-6a9dfef89fe6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.641067] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e88f5716-5f3a-4d3a-88ec-31a31cb322f3 [ 815.641067] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.641067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.641067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.641067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.641067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.641067] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e88f5716-5f3a-4d3a-88ec-31a31cb322f3 already deleted. [ 815.641067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e88f5716-5f3a-4d3a-88ec-31a31cb322f3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.708021] env[65353]: INFO networking_nsxv3.common.synchronization [req-a6a0e9c6-11fc-4bda-8294-53b779d52b32 req-e5368e6f-f29a-44ae-a40c-d30173a0fe9d tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 815.708021] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 815.708021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.708021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.708021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.708021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.708021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.708021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.708774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.708774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.708774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.708774] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.714734] env[65353]: INFO networking_nsxv3.common.synchronization [req-6f24eac7-6dcf-4ceb-a662-f2da5214665c req-533ff7fa-0134-421d-9236-4c0465fb628c tempest-ListServersNegativeTestJSON-468958272 tempest-ListServersNegativeTestJSON-468958272-project-member] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 815.715595] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGHEST for action security_group_members [ 815.715595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.715595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.933525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.933942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.943021] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.943021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 with status ACTIVE [ 815.943021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.943021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.943021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.943021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.943756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.943756] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abc357d9-7c3f-40e9-8d03-6a9dfef89fe6 is going to be updated. [ 815.967049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.967049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.967049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.967322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.967941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.967941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abc357d9-7c3f-40e9-8d03-6a9dfef89fe6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.121926] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 816.122186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.214259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.214378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.214443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.215527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.215630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.215841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.215942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.216021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.216168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.216245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.216353] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 816.252352] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.252352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.252352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.252352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.252578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.262804] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 816.287832] env[65353]: INFO networking_nsxv3.common.synchronization [req-627fcea5-6135-402c-844e-58b8359f0fd4 req-266e4c67-c162-4397-b73d-50ff223c40d6 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 816.289668] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 816.289668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.289668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.289668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.289668] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.448405] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.651261] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.651462] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.651564] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.651856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.653225] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.653440] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.653563] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.653797] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.653948] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.654237] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.654289] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.654388] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.654490] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.654596] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.654699] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.654829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.676249] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.676440] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.676593] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.676865] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-209" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.677099] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-c876929a-ffd4-48c4-9827-b350e73ef787 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.677274] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.677393] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.677802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.677883] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c876929a-ffd4-48c4-9827-b350e73ef787',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.792268] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.951183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.951183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.952043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.952043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.952043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.952043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc8572-c14a-4402-8307-015f5348ce03 is going to be created. [ 816.980134] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.981014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.981014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.981014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.981177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.994835] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: UNINITIALIZED for 2s [ 817.180737] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.180909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.181069] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.181353] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.181506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.181657] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port c876929a-ffd4-48c4-9827-b350e73ef787 not found, creating... [ 817.181913] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.182080] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.182195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.182413] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.182547] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.182820] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.183013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.183182] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.183396] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.183533] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.183668] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: c876929a-ffd4-48c4-9827-b350e73ef787 is going to be created. [ 817.204483] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.204694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.204814] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.205107] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.205366] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.205602] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.235549] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2735c96f-e54c-4e78-b5e5-9c06cf9ee878 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 817.236199] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 817.236519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.236803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.236803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.236946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.237946] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.298520] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.376113] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a3cb6776-9aa8-48fe-ac95-25d4e2222be4 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 817.376860] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 817.377191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.377424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.564288] env[65353]: INFO networking_nsxv3.common.synchronization [None req-50b98465-96e7-48ef-be1d-65e509aa015e None None] Enqueued Resource ID: 6ee56e1e-f60f-46a8-aa32-ee3a8905426c with Priority: HIGHEST for action port [ 817.564634] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ee56e1e-f60f-46a8-aa32-ee3a8905426c with Priority: HIGHEST for action port [ 817.564965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ee56e1e-f60f-46a8-aa32-ee3a8905426c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.567322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ee56e1e-f60f-46a8-aa32-ee3a8905426c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.567322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ee56e1e-f60f-46a8-aa32-ee3a8905426c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.567322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ee56e1e-f60f-46a8-aa32-ee3a8905426c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.567322] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee56e1e-f60f-46a8-aa32-ee3a8905426c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.764741] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.764961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.764961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.765242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.765302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.765779] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae already deleted. [ 817.765779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.765962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.766057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.766147] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.800441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.800847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.800847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.801253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.801414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.801548] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 817.889435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.889718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.890160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.890316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.903620] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [req-627fcea5-6135-402c-844e-58b8359f0fd4 req-eee9287f-e351-460b-9ff9-08f92f7958c7 service nova] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [req-627fcea5-6135-402c-844e-58b8359f0fd4 req-eee9287f-e351-460b-9ff9-08f92f7958c7 service nova] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [req-627fcea5-6135-402c-844e-58b8359f0fd4 req-eee9287f-e351-460b-9ff9-08f92f7958c7 service nova] Enqueued Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 817.971608] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 817.971608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.971608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.971608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.971608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.971608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.972224] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.972224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.972512] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c876929a-ffd4-48c4-9827-b350e73ef787 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.972512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.972512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.972736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.972841] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c876929a-ffd4-48c4-9827-b350e73ef787',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.068855] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ee56e1e-f60f-46a8-aa32-ee3a8905426c [ 818.069174] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.069466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.069466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.069613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.069706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.069806] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ee56e1e-f60f-46a8-aa32-ee3a8905426c already deleted. [ 818.069889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ee56e1e-f60f-46a8-aa32-ee3a8905426c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.275430] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 818.275430] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 deletion is rescheduled due to dependency. [ 818.275430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.275561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.275677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.275857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.276725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.276725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.276725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.276725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.276725] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.295192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.296369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.296369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.296369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.296369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.296369] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae already deleted. [ 818.296369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.474606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.474852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.475097] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c876929a-ffd4-48c4-9827-b350e73ef787 with status ACTIVE [ 818.475359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.475515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.475555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.475746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.475836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.476040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.476116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.476185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.476333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.476410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.476592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.476683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.476742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.476881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.476953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.477051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c876929a-ffd4-48c4-9827-b350e73ef787 is going to be updated. [ 818.500854] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.501022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.501075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.501282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.501419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.501576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.779413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.779608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.779693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.779947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.780096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.780306] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.780428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.780505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.780646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.780725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.780881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be updated. [ 818.813576] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.813881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.813881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.814075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.814186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.824272] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: IN_PROGRESS for 2s [ 819.006482] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: SUCCESS [ 819.006482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.006482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.006653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.006846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.006969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.007033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.007186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.007266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.007346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.007434] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.493671] env[65353]: INFO networking_nsxv3.common.synchronization [req-55b052c4-756b-43ab-9b58-08b3a79c13c3 req-f9ee1c9b-eec2-4d17-9ab7-9f15206294d6 tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 819.494366] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 819.494750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.494882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.494950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.495206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.496357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.496357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.496357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.496357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.496357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.496357] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.509795] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.509972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.510128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510417] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.510562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.510562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.510932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.511054] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.511144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.511408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.511408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.511884] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.511884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.511884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.511884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.511884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.513104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.513104] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.917658] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.918936] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.918936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.919292] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.998110] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.998263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.998323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.998536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.998624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.998825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.998926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.998980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.999553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.999553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.999553] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 820.016640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fedc8572-c14a-4402-8307-015f5348ce03: rpc.has_security_group_logging(os_id): False [ 820.032291] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.032423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.032492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.035152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.035392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.037847] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.038162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.038162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.038333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.038411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.038608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.038706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.038766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.038914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.038987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.039192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.039377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.039445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.039632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.039709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.040857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.040857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.040857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.040857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.040857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.040857] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fedc8572-c14a-4402-8307-015f5348ce03 is going to be created. [ 820.050952] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 820.121552] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.121861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.121861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.122049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.122806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.133879] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: IN_PROGRESS for 2s [ 820.421783] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.732864] env[65353]: INFO networking_nsxv3.common.synchronization [req-1e604627-e216-4dab-bc29-2517622ed30d req-daed0d4a-3666-4235-ad7a-2630fc3dbde0 tempest-ServerGroupTestJSON-77265041 tempest-ServerGroupTestJSON-77265041-project-member] Enqueued Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 820.734379] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGHEST for action security_group_members [ 820.734725] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.734848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.734913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.735132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.735290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.735417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.735477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.735656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.735743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.735836] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.807972] env[65353]: INFO networking_nsxv3.common.synchronization [req-be253075-51bf-4036-a201-ae09d6e6ce99 req-925a2bfb-0b90-4702-b727-975b99637973 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 820.808788] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 820.808929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.812078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.812203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.812456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.812633] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.812732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.813139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.813139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.813139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.813394] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.835054] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 in Status: SUCCESS [ 820.835254] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 deletion is rescheduled due to dependency. [ 820.835372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.926530] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.116984] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.116984] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.117167] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.117315] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.117560] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.117708] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.117815] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.118359] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.118506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.118713] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.120043] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.120043] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.120043] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.120043] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.120043] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.120043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.139478] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.139659] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.139795] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.139968] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.140303] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-49176593-0e30-4752-988c-43e1f77d2f90 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.140481] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.140578] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.143075] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.143075] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49176593-0e30-4752-988c-43e1f77d2f90',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.238729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.238729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.238729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.238915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.239014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.239247] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.239361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.239424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.239582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.239656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.239743] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae is going to be updated. [ 821.270192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.270192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.270192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.270354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.270474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.280645] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: IN_PROGRESS for 2s [ 821.315982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.316268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.316268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.316461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.316552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.316751] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.316856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.316908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.317068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.317137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.317222] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 already deleted. [ 821.317474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.429039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.429223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.429264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.429474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.429562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.429660] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 821.466086] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.466086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.466086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.466086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.466086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.476696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 821.646215] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.646215] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 49176593-0e30-4752-988c-43e1f77d2f90 not found, creating... [ 821.646215] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.646215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.646723] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.646723] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.646723] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.646912] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.647016] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.647695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.647835] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 49176593-0e30-4752-988c-43e1f77d2f90 is going to be created. [ 821.668017] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.668230] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.668366] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.668643] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.668855] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.669082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.061182] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 822.061504] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e deletion is rescheduled due to dependency. [ 822.061504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.146546] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: SUCCESS [ 822.146783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.383642] env[65353]: INFO networking_nsxv3.common.synchronization [req-be253075-51bf-4036-a201-ae09d6e6ce99 req-be432877-4daf-41f7-9011-29bece18eed0 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 822.383874] env[65353]: INFO networking_nsxv3.common.synchronization [req-be253075-51bf-4036-a201-ae09d6e6ce99 req-be432877-4daf-41f7-9011-29bece18eed0 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 822.384054] env[65353]: INFO networking_nsxv3.common.synchronization [req-be253075-51bf-4036-a201-ae09d6e6ce99 req-be432877-4daf-41f7-9011-29bece18eed0 service nova] Enqueued Resource ID: 49176593-0e30-4752-988c-43e1f77d2f90 with Priority: HIGHEST for action port [ 822.384605] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 822.384742] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 822.384838] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49176593-0e30-4752-988c-43e1f77d2f90 with Priority: HIGHEST for action port [ 822.388031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.388031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.388031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.388031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.388031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.388031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.390063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-49176593-0e30-4752-988c-43e1f77d2f90 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.390657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.392178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.392434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.392564] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49176593-0e30-4752-988c-43e1f77d2f90',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.894612] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.895957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.896129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.896403] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49176593-0e30-4752-988c-43e1f77d2f90 with status ACTIVE [ 822.896673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.896795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.896881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.897771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.897771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.898952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.898952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.898952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.898952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.898952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.899319] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.899319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.899319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.899426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.899426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.899555] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49176593-0e30-4752-988c-43e1f77d2f90 is going to be updated. [ 822.919830] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.920025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.920080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.920307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.920451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.920614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49176593-0e30-4752-988c-43e1f77d2f90" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.294022] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae in Status: SUCCESS [ 823.294022] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae deletion is rescheduled due to dependency. [ 823.294022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.378758] env[65353]: INFO networking_nsxv3.common.synchronization [req-5db154d3-19a7-44b9-909b-3736e43b8aa6 req-d7eee26e-f018-45d7-851f-84157ba80224 tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 823.379954] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 823.379954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.379954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.379954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.380228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.380228] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.380319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.380351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.380789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.380789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.380789] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.401624] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.487173] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 823.487453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.487633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.487865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.488087] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.488232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.488307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.488551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.488653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.488723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.488809] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.827690] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.827981] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.828053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.828402] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.828674] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.828829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.828943] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.829363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.829363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.829524] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.829633] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.829775] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.830730] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.830730] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.830730] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.830730] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.862374] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.862602] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.862767] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.863036] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-994" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.864420] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.864420] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.864420] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.864420] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.864420] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.884169] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.904702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.904702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.904702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.904702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.904702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.904702] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be created. [ 823.930788] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.930995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.931096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.931338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.931536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.942833] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: UNINITIALIZED for 2s [ 823.991876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.992009] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.992082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.993042] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.993042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.993523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.993523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.993523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.993523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.993805] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.993805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.993805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.993805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.994086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.994086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.994187] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.367637] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.368067] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.368252] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.368648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.368874] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.369125] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 not found, creating... [ 824.369471] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.369911] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.370088] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.370421] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.370572] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.370926] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.371134] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.371267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.371498] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.371744] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.372080] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 is going to be created. [ 824.385914] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.394823] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.395119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.395249] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.395523] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.395748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.396007] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.496872] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 824.524867] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.525045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.525111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.525340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.525429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.525652] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.525750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.525813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.525967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.526061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.526277] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.526420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.526463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.526642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.526700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.526865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.526957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.527030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.527176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.527248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.527336] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 824.619042] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.619258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.619311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.619637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.619865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.644037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 824.889700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.889972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.889972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.890348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.890348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.890469] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 824.933355] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.933355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.933553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.935229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.935229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.945805] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 825.139638] env[65353]: INFO networking_nsxv3.common.synchronization [req-5db154d3-19a7-44b9-909b-3736e43b8aa6 req-234dc3b1-8b59-49e9-98f1-4e599f0bf18c service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 825.139802] env[65353]: INFO networking_nsxv3.common.synchronization [req-5db154d3-19a7-44b9-909b-3736e43b8aa6 req-234dc3b1-8b59-49e9-98f1-4e599f0bf18c service nova] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 825.139932] env[65353]: INFO networking_nsxv3.common.synchronization [req-5db154d3-19a7-44b9-909b-3736e43b8aa6 req-234dc3b1-8b59-49e9-98f1-4e599f0bf18c service nova] Enqueued Resource ID: 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 with Priority: HIGHEST for action port [ 825.140494] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_rules [ 825.140641] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 825.140801] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 with Priority: HIGHEST for action port [ 825.141262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.141262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.141418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.141465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.141582] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.142499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.142594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.143031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.143031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.143031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.143527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.143527] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.646475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.646736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.647988] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 with status ACTIVE [ 825.648158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.648279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.648345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.648553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.648641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.649078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.649078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.649078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.649197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.649197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.649342] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.649430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.649488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.649619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.649689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.649769] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20 is going to be updated. [ 825.672086] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.672183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.672244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.672440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.672600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.673089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8834c9dc-1f1d-4e0c-bb4e-34b6dd2c0d20" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.954431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 825.954728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.955020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.955275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.955511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.955660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.955740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.956134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.956134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.956284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.956284] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.199924] env[65353]: INFO networking_nsxv3.common.synchronization [req-24237239-de03-45b8-90cd-e60af1aa663c req-56588cef-e0c0-4843-90ed-2321e2b5ab70 tempest-ServerMetadataNegativeTestJSON-1440814636 tempest-ServerMetadataNegativeTestJSON-1440814636-project-member] Enqueued Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 826.200434] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 826.200741] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.200859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.201045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.201317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.201479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.201574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.201634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.201781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.201885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.201980] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.464047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.464047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.464047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.464983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.464983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.464983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.464983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.465335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.465335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.465335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.465531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.465531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.465531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.465697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.465810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.465874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.465928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.466807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.466807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.466807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.466807] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.551568] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552379] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.552379] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552379] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.553085] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.553283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.553400] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.553642] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.553781] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.554030] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.554156] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.554235] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.554340] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.554417] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.554515] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.554641] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.576194] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.576439] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.576590] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.576835] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.577104] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-2162e8b6-fbfb-4911-99fd-e612df03e9c2 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.577281] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.577390] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.577703] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.577837] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2162e8b6-fbfb-4911-99fd-e612df03e9c2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.663685] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 826.663930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.705933] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.705933] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.705933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d already deleted. [ 826.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.959326] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.959326] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.959326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.959326] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.968878] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e718fc6-a572-4276-83ab-0e7e530140d0: rpc.has_security_group_logging(os_id): False [ 826.987322] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.987501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.987575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.987786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.987876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.988084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.988187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.988259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.989023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.989023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.989393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.989393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.989393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.989501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.989653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.989727] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be created. [ 827.048660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.048738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.048775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.048982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.049235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.063569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 827.080559] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.080916] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.081101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.081495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.082151] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.082151] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 2162e8b6-fbfb-4911-99fd-e612df03e9c2 not found, creating... [ 827.082443] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.082698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.082881] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.083228] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.083454] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.083876] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.084108] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.084297] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.084605] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.084787] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.084943] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 2162e8b6-fbfb-4911-99fd-e612df03e9c2 is going to be created. [ 827.119477] env[65353]: INFO networking_nsxv3.common.synchronization [req-9a24b072-5839-4b41-a422-e5c0bd2c56d8 req-4003a876-e359-4ce5-973f-bb3a37f52eb5 tempest-ImagesNegativeTestJSON-718148462 tempest-ImagesNegativeTestJSON-718148462-project-member] Enqueued Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 827.120077] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGHEST for action security_group_members [ 827.120408] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.120534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.120670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.120799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.120955] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.121067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.121131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.121273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.121359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.121454] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.133565] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.133707] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.133829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.134156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.134384] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.134625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.462031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.625012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.625263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.625342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.625594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.625714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.625929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.626081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.626156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.626317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.626389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.626475] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc8572-c14a-4402-8307-015f5348ce03 is going to be updated. [ 827.662786] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.662786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.662786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.662786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.663708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.673596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: IN_PROGRESS for 2s [ 827.820195] env[65353]: INFO networking_nsxv3.common.synchronization [req-24237239-de03-45b8-90cd-e60af1aa663c req-fdc3a5f8-7a0f-4d29-affe-c3fb166002ca service nova] Enqueued Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_rules [ 827.820195] env[65353]: INFO networking_nsxv3.common.synchronization [req-24237239-de03-45b8-90cd-e60af1aa663c req-fdc3a5f8-7a0f-4d29-affe-c3fb166002ca service nova] Enqueued Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 827.820195] env[65353]: INFO networking_nsxv3.common.synchronization [req-24237239-de03-45b8-90cd-e60af1aa663c req-fdc3a5f8-7a0f-4d29-affe-c3fb166002ca service nova] Enqueued Resource ID: 2162e8b6-fbfb-4911-99fd-e612df03e9c2 with Priority: HIGHEST for action port [ 827.820478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_rules [ 827.820626] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 827.820878] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2162e8b6-fbfb-4911-99fd-e612df03e9c2 with Priority: HIGHEST for action port [ 827.821125] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.821258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.821320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.821563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.821647] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.822550] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.822679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.822736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.822931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.824665] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.824795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.824845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.825626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.825743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.827031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.827031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2162e8b6-fbfb-4911-99fd-e612df03e9c2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.827031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.827031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.827240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.827274] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2162e8b6-fbfb-4911-99fd-e612df03e9c2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.964471] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.329800] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.330589] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.330589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.330589] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2162e8b6-fbfb-4911-99fd-e612df03e9c2 with status ACTIVE [ 828.330954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.330954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.330954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.331447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.331447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.331509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.331555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.331647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.332217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.332217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.332217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.332614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.332614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.332614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.332722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.332948] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2162e8b6-fbfb-4911-99fd-e612df03e9c2 is going to be updated. [ 828.357047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.357233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.357297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.357510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.357667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.358220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2162e8b6-fbfb-4911-99fd-e612df03e9c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.467344] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.467504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.467619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.467887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.467962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.468040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 828.511987] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.512156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.512237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.512451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.512603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.526382] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 828.835136] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.048845] env[65353]: INFO networking_nsxv3.common.synchronization [req-702d1adc-1a13-4f8a-b527-ecc6d399a3fb req-a16d5547-1fb0-4288-aba5-3ddff6b94f7b tempest-AttachInterfacesV270Test-707008197 tempest-AttachInterfacesV270Test-707008197-project-member] Enqueued Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 829.049418] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 829.050616] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.050868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.050948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.051231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.051405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.051548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.051613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.051718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.051807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.051898] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.093422] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 829.093422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.340578] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.340824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.340948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.341282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.341430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.341579] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d is going to be created. [ 829.368592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.368592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.368592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.368732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.369045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.379962] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: UNINITIALIZED for 2s [ 829.431024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.431024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-519" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.431024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-519" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.431024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-519" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.431024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.431024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.431868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.432450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.432792] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.433204] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.433434] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.433643] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.433847] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.436015] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.436015] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.436015] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.454711] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.454711] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.454711] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.454711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-519" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.454711] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.455056] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.455130] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.455652] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.455652] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa72d9f-254d-4ab6-97f1-b3b414e4cc14',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.557339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.557543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.557615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.557815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.557899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558129] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.559031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.559031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.559031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9972817-ff77-432f-a5cd-8388f88bd29a already deleted. [ 829.559031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.685606] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc8572-c14a-4402-8307-015f5348ce03 in Status: SUCCESS [ 829.685606] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc8572-c14a-4402-8307-015f5348ce03 deletion is rescheduled due to dependency. [ 829.685606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.958504] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.958504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.958504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.958998] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.959068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.959204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 not found, creating... [ 829.959458] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.959612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.959723] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.959940] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.960094] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.960378] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.960513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.960625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.960823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.960951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.961167] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 is going to be created. [ 829.994106] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.994106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.994106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.994106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.994392] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.994541] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.536504] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 830.536728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.536914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.537158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.537393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.537525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.537620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.537810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.537895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.537981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.538098] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.677366] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 830.677366] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 830.677366] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 830.677845] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 830.678393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.678721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.678939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.679428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.679736] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.679989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.680186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.682019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.682019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.682019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.682019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.682424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.682637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.683040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.685765] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.685765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.685765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.685765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.685765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.685765] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [req-702d1adc-1a13-4f8a-b527-ecc6d399a3fb req-9c030cef-f820-4808-af46-6a14e2cbbe1b service nova] Enqueued Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_rules [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [req-702d1adc-1a13-4f8a-b527-ecc6d399a3fb req-9c030cef-f820-4808-af46-6a14e2cbbe1b service nova] Enqueued Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [req-702d1adc-1a13-4f8a-b527-ecc6d399a3fb req-9c030cef-f820-4808-af46-6a14e2cbbe1b service nova] Enqueued Resource ID: 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 with Priority: HIGHEST for action port [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_rules [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 830.695227] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 with Priority: HIGHEST for action port [ 830.695227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.695227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.695227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.695969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.696162] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.697495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.697726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.697892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.698169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.700223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.701616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.701616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.701616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.701616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.701616] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.703180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.703180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.703180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.703180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.703180] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa72d9f-254d-4ab6-97f1-b3b414e4cc14',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.760488] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 830.760488] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 830.760488] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_rules [ 830.760488] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 830.760488] env[65353]: INFO networking_nsxv3.common.synchronization [req-1203c536-5077-42b2-87b7-5c8a0769a723 req-9088ddbf-a061-40cd-8bcd-c0ea0424ce8e tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 830.761757] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 830.762118] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_rules [ 830.762349] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 830.762555] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 830.762746] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 830.763500] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.763807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.763968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.764492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.764895] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.766791] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.770034] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.770034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c876929a-ffd4-48c4-9827-b350e73ef787 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.770034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.770034] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c876929a-ffd4-48c4-9827-b350e73ef787',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.770986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.771274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.771620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.771804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.041354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.041354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.041354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.041354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.041354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.041835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.041835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.041835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.041835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.041835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.041988] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.042059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.042124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.042277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.042414] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.042503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.042562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.042694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.042768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.042848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.042937] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.186682] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.187635] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.203859] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.210963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.210963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212343] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 with status ACTIVE [ 831.212536] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.212818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.212973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.213061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.213242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.213342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.213402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.213562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.213651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.213831] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.213921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.213980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.214335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.214441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.214542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fa72d9f-254d-4ab6-97f1-b3b414e4cc14 is going to be updated. [ 831.241714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.241714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.241714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.241965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.242137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.242313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa72d9f-254d-4ab6-97f1-b3b414e4cc14" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.273619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c876929a-ffd4-48c4-9827-b350e73ef787 with status ACTIVE [ 831.273791] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.273853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.273886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.274147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.274247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.274421] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.274521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.274579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.274732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.274811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.274993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.275102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.275195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.275345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.275415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.275505] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c876929a-ffd4-48c4-9827-b350e73ef787 is going to be updated. [ 831.277985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.277985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.277985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.277985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.305087] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.305238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.305238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.305751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.305751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.305751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.404554] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: SUCCESS [ 831.404907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.405157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.405412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.406253] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.406426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.406519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.406783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.406903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.406996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.407109] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.547164] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2f635c3-4601-4155-b8e5-e2dab677e518: rpc.has_security_group_logging(os_id): False [ 831.577602] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.578345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.578345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.578345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.602430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.602721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.602849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.602916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.603194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.603280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.603651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.603651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.603651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.603841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.603841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.604333] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.604509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.604581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.604746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.604829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.604922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 831.680117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.680276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.680365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.680577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.680736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.689494] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.693649] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.696987] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 831.707933] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.910858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.911112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.911191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.911452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.911653] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.911798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.911886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.912068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.912832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.912832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.912832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.912832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.912832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.912832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.912832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.914264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.914264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.914264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.914264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.914264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.914264] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.191545] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.191912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.191912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.192063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.192063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.192163] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 832.197119] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.197293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.197361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.197577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.197671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.197765] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be created. [ 832.211101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.211101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.211345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.211399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.211447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.211535] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9972817-ff77-432f-a5cd-8388f88bd29a is going to be created. [ 832.223880] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.224078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.224141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.224301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.224459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.230606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.230803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.230803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.231078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.231171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.242970] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: UNINITIALIZED for 2s [ 832.243680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 832.244426] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.244555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.244620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.244819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.244973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.255049] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: UNINITIALIZED for 2s [ 832.416128] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ef686cd-78eb-46c8-a0b8-b56b7873d69d: rpc.has_security_group_logging(os_id): False [ 832.440581] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.440731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.440802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.441062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.441133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.441341] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.441439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.441503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.441652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.441723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.441902] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.441996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.442085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.442227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.442299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.442496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.442574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.442661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.442813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.442887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.442973] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d is going to be created. [ 832.521942] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.522150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.522211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.522370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.522572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.534650] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: IN_PROGRESS for 2s [ 833.715135] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 833.716158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.092491] env[65353]: INFO networking_nsxv3.common.synchronization [req-0f4714a8-c0cc-4d3d-96d1-51f0ac3f03a2 req-cde55bc5-cc6b-4a00-bfcd-3496cea7011a tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 834.092646] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 834.094259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.095178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.095422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.095893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.096216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.097161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.098236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.098500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.098560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.099360] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.258481] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: SUCCESS [ 834.258704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.260880] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 834.261204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.261374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.261594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.261782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.261975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.261975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.262682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.262682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.262792] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.265395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.266403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.266603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.266727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.266784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.267873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.267976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.268094] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.283906] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: SUCCESS [ 834.283906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.284364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.284578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.284767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.284871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.284927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.285083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.285154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.285236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.285320] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.478547] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.478747] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.478860] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.479240] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.479498] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.479651] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.479763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.479973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.480785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.481097] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.481221] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.481329] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.481436] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.481542] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.481646] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.481776] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.504021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.504021] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.504021] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.504021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.504021] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.504021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.504021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.504543] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.504768] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2692ead-6ddf-421f-96c1-22abbaa1b4a0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.547864] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: SUCCESS [ 834.548142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.602889] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.603152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.603152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.603374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.603464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.603661] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.603905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.603905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.604012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.604074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.604145] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff already deleted. [ 834.604231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.771602] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.772664] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.787868] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.788149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.788149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.788375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.788466] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.788596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.788596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.788753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.788866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.788866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.788994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.789109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.789208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.789290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.789409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.789494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.789550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.789673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.789741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.789812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.789928] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.006934] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.007184] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.007307] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.007604] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.007748] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.007893] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port a2692ead-6ddf-421f-96c1-22abbaa1b4a0 not found, creating... [ 835.008162] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.008318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.008433] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.008649] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.008769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.009114] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.009190] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.009504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.009504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.009674] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.009868] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: a2692ead-6ddf-421f-96c1-22abbaa1b4a0 is going to be created. [ 835.031720] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.031927] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.032059] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.032452] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.032724] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.032959] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.274579] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.275745] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.291457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9972817-ff77-432f-a5cd-8388f88bd29a: rpc.has_security_group_logging(os_id): False [ 835.316260] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.316423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.316499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.316772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.316912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.317178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.317328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.317422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.317620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.317723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.317962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.319168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.319168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.319340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.319382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.319589] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.319713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.319784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.319958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.320053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.320141] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9972817-ff77-432f-a5cd-8388f88bd29a is going to be created. [ 835.389488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.389488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.389488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.389873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.389873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.407148] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: IN_PROGRESS for 2s [ 835.779481] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.780061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.780061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.780206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.780206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.780483] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be updated. [ 835.781973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.782107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.782181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.782375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.782452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.782562] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 835.817989] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.817989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.817989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.818259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.818259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.820494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.820621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.820720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.820859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.821010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.833313] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: IN_PROGRESS for 2s [ 835.834029] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 835.896439] env[65353]: INFO networking_nsxv3.common.synchronization [req-0f4714a8-c0cc-4d3d-96d1-51f0ac3f03a2 req-456856ab-483d-4480-b7a3-e4eb90222497 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 835.896730] env[65353]: INFO networking_nsxv3.common.synchronization [req-0f4714a8-c0cc-4d3d-96d1-51f0ac3f03a2 req-456856ab-483d-4480-b7a3-e4eb90222497 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 835.896802] env[65353]: INFO networking_nsxv3.common.synchronization [req-0f4714a8-c0cc-4d3d-96d1-51f0ac3f03a2 req-456856ab-483d-4480-b7a3-e4eb90222497 service nova] Enqueued Resource ID: a2692ead-6ddf-421f-96c1-22abbaa1b4a0 with Priority: HIGHEST for action port [ 835.897545] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 835.897713] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 835.897877] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2692ead-6ddf-421f-96c1-22abbaa1b4a0 with Priority: HIGHEST for action port [ 835.898276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.898420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.898471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.898665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.898782] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.899865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.900117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.900193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.900543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.900686] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.900832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.900921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.901310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.901310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.901834] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.902350] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.902453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.902535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.902695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.902789] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2692ead-6ddf-421f-96c1-22abbaa1b4a0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.272184] env[65353]: INFO networking_nsxv3.common.synchronization [req-de9663e0-80e3-4133-8b0a-97503142cdc4 req-fb26a447-49c5-4c00-898a-72cd0c8ece11 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 836.272474] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 836.272805] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.272946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.273031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.273291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.273449] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.273553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.273615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.273795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.273895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.273992] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.406265] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2692ead-6ddf-421f-96c1-22abbaa1b4a0 with status ACTIVE [ 836.406265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.406265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.406265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.406265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.406265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.406636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.406636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.406636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.406636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.406830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.406830] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.407028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.407028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.407125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.407177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.407269] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2692ead-6ddf-421f-96c1-22abbaa1b4a0 is going to be updated. [ 836.408445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.408541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.408711] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.432210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.432409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.432468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.432683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.432827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.432989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2692ead-6ddf-421f-96c1-22abbaa1b4a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.777195] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.777393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.777467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.777646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.777751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.778039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.778154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.778225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.778726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.778726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.778726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 836.813782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.813782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.813782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.813782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.814444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.829799] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 836.911191] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.095685] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 837.095946] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 837.095994] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 837.096617] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 837.096989] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 837.097145] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 837.097537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-493976fc-b155-4f7b-9564-bec8067e71bd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.097625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.097625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.097911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.098088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.098216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.098265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.098439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.098485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.098586] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.099535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.099646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.100409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.100409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.155423] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_rules [ 837.155423] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 837.155423] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 837.155423] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 837.155423] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_rules [ 837.155883] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 837.156157] env[65353]: INFO networking_nsxv3.common.synchronization [req-924df617-cd73-4e02-a8cc-ed1e23b1eefa req-85427926-9590-4b39-98c9-07f0d8c78940 tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 837.156999] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_rules [ 837.157334] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_rules [ 837.161102] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 837.161102] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c876929a-ffd4-48c4-9827-b350e73ef787 with Priority: HIGHEST for action port [ 837.161102] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_rules [ 837.161102] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 837.161102] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 837.161102] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-493976fc-b155-4f7b-9564-bec8067e71bd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.161102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.161102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.161102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.161102] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.162259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.162427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.163058] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.163058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.163274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c876929a-ffd4-48c4-9827-b350e73ef787 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.163381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.165930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.165930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.165930] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c876929a-ffd4-48c4-9827-b350e73ef787',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.165930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.165930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.165930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-493976fc-b155-4f7b-9564-bec8067e71bd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.165930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.165930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.165930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.413877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.416409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.416409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.416409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.416409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.416409] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be created. [ 837.425927] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: SUCCESS [ 837.426055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.443751] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.443914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.444362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.444362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.444544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.455959] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: UNINITIALIZED for 2s [ 837.602750] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.666229] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-493976fc-b155-4f7b-9564-bec8067e71bd taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.666434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.668810] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c876929a-ffd4-48c4-9827-b350e73ef787 with status ACTIVE [ 837.669023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.669149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.669216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.669449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.669541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.669726] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.669825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.669886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.670048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.670128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.670309] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.670404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.670461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.670597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.670670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.670752] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c876929a-ffd4-48c4-9827-b350e73ef787 is going to be updated. [ 837.693253] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.693412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.693478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.693689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.693827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.693991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c876929a-ffd4-48c4-9827-b350e73ef787" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.858464] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: SUCCESS [ 837.858464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.858464] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 837.858464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.858464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.858464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.859559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.859559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.859559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.859559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.859559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.859559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.859931] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.860690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.860864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.862808] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.862808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.862808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.862808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.862808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.862808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.862808] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.864414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.864414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.864564] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.864835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.864914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.865165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.865263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.865398] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.866865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.867078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.867280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.867413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.867631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.867709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.867767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.869035] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.107617] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.366404] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.370862] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.371103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.371255] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.372122] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.610014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.610241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.610353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.610642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.610785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.610922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd is going to be created. [ 838.613338] env[65353]: INFO networking_nsxv3.common.synchronization [req-a5685ff0-fb0f-40b5-b9a9-c08ba84cf0c3 req-dc6276f4-9139-4987-97b5-c6045cea6dda tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 838.615619] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 838.615619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.615619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.615619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.615619] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.637044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.637196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.637351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.637630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.637806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.648671] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 493976fc-b155-4f7b-9564-bec8067e71bd in Status: UNINITIALIZED for 2s [ 838.840350] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 838.840635] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 deletion is rescheduled due to dependency. [ 838.840816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.869432] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3a32291-0504-4a58-83e8-3f2c4277ee9f: rpc.has_security_group_logging(os_id): False [ 838.874766] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.876466] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.896039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.896039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.896244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.896645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.896768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.897088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.897360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.897564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.897821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.897979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.898100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be created. [ 838.974890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.975287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.975465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.975757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.975989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.989800] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: IN_PROGRESS for 2s [ 839.119762] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.259760] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-ccb203c1-75aa-4689-a2fc-5f185f4ab314 tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 839.260501] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 839.260722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.260846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.260912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.261144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.261300] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.261397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.261457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.261611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.261695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.261789] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.382339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.382339] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be updated. [ 839.382339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.382339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.384100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 839.426494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.426680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.426750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.426900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.427064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.428918] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.429051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.429127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.429327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.429428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.442713] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 839.442713] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: IN_PROGRESS for 2s [ 839.469161] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 839.469489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.469793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.470018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.470290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.470455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.470569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.470777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.470906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.471791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.471942] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.621902] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.666534] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-053b3602-a469-4e49-9bbf-bdcacff4e4a3 tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 839.667112] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 839.670044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.670044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.764338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.764477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.765487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.765487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.791338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.791471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.791544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.792121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.792266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.792446] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 839.863064] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.863064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.863064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.863064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.863064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.877802] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 839.975600] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.126304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.126304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.126304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.126304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.126304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.126592] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 840.151393] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-661 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.151580] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-661" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.151695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-661" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.152570] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-661" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.152570] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.152570] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.152570] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.153377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.153377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.153524] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.153595] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.153662] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.153773] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.155444] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.155444] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.155444] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.166239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.166361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.166431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.166777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.166943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.176298] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.176453] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.179556] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.179556] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-661" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.179556] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.179556] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.179556] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.179556] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.179556] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9158cc72-49d3-4ba6-a3fa-b9fb84f1c658',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.180312] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 840.479692] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff: rpc.has_security_group_logging(os_id): False [ 840.498136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.498340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.498340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.498617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.498698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.498875] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.498972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.499047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.499228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.499313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.499355] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be created. [ 840.520900] env[65353]: INFO networking_nsxv3.common.synchronization [req-085a7341-d681-4e97-800f-de588fd6844a req-b05dbfe8-38e3-43cd-be1e-3301cdcb0ced tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 840.521092] env[65353]: INFO networking_nsxv3.common.synchronization [req-085a7341-d681-4e97-800f-de588fd6844a req-b05dbfe8-38e3-43cd-be1e-3301cdcb0ced tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 840.521214] env[65353]: INFO networking_nsxv3.common.synchronization [req-085a7341-d681-4e97-800f-de588fd6844a req-b05dbfe8-38e3-43cd-be1e-3301cdcb0ced tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 840.521770] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493976fc-b155-4f7b-9564-bec8067e71bd with Priority: HIGHEST for action security_group_members [ 840.521911] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 840.522014] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f with Priority: HIGHEST for action security_group_members [ 840.522551] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-493976fc-b155-4f7b-9564-bec8067e71bd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.522757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.522987] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.523152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.523342] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3a32291-0504-4a58-83e8-3f2c4277ee9f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.523433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.563308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.563506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.563506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.563771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.563957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.576158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 840.665345] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 493976fc-b155-4f7b-9564-bec8067e71bd in Status: SUCCESS [ 840.665608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.665745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.665967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.666169] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.666281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.666340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.666504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.666564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.666656] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.680908] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.681246] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.681416] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.681751] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.681932] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.682229] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 not found, creating... [ 840.682621] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.682810] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.682976] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.683350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.683628] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.684170] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.684444] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.684608] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.684930] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.685231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.685457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 is going to be created. [ 840.729024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.729272] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.729439] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.729820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.730135] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.730442] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.933240] env[65353]: INFO networking_nsxv3.common.synchronization [req-b9b59dc0-dc4b-42b2-86f4-76fb9811d2a2 req-b16813b3-96cc-44d5-90ed-a6b8cd9cf32c tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 840.934459] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGHEST for action security_group_members [ 840.934459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.934459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.934459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.934774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.934833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.934920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.934979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.935112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.935333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.935333] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.007400] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: SUCCESS [ 841.007897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.007897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.008150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.008150] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.169031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.169205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.169307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.169662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.169662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.169854] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.169975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.170067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.170264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.170339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.170453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd is going to be deleted. [ 841.205949] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.206392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.206477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.207037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.207037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.207037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.207244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.207244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.208027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.208027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.208027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.208027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.208027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.208027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.439470] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.439470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.439470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.439753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.439976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.440082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.440207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.440272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.440428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.440555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.440601] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 is going to be updated. [ 841.462060] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f in Status: SUCCESS [ 841.462060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.462232] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 841.462385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.462539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.462748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.462929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.463059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.463167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.463417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.463417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.463515] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.464968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.464968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.464968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.464968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.464968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.464968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.465202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.465202] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.472078] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-916aa13f-adca-481c-b779-9a95dfa9510f service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 841.472078] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-916aa13f-adca-481c-b779-9a95dfa9510f service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 841.472255] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-916aa13f-adca-481c-b779-9a95dfa9510f service nova] Enqueued Resource ID: 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 with Priority: HIGHEST for action port [ 841.472565] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 841.472655] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 841.472698] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 with Priority: HIGHEST for action port [ 841.473606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.473606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.473606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.474257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.474257] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.476703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.476703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.476703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.476703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.476703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.476703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.476703] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9158cc72-49d3-4ba6-a3fa-b9fb84f1c658',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.594957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.595126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.595196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.595421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.595567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.605377] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: IN_PROGRESS for 2s [ 841.612319] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.612478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.612859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.613194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.613407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.613542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be deleted. [ 841.691920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.691920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.691920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.692175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.692274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.693055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.711222] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.711446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.711545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.713874] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.713874] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd already deleted. [ 841.713874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.713874] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.714455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.714455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.714694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.715589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.715589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.715589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.715589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.715589] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.895325] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 841.896032] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 deletion is rescheduled due to dependency. [ 841.896244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.896365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.896591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.897053] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.897053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.897053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.897484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.897484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.897484] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.968054] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.968054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.968054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.968450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.968450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.968597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.968694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.968744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.968893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.968960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.969088] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f is going to be deleted. [ 841.970100] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.977892] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.978034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.979551] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 with status ACTIVE [ 841.979773] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.979947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.979947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.980137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.980217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.980440] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.980531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.980586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.981011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.981011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.981011] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.981238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.981280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.981395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.981473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.981570] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9158cc72-49d3-4ba6-a3fa-b9fb84f1c658 is going to be updated. [ 842.000835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.001041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.001093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.002440] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.002440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.002440] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3a32291-0504-4a58-83e8-3f2c4277ee9f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.004145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.004145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.004329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.004426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.004505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.004664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9158cc72-49d3-4ba6-a3fa-b9fb84f1c658" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.200899] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 842.201398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220407] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('493976fc-b155-4f7b-9564-bec8067e71bd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.221541] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.222102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.222102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.222102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.222254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.222389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.222527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.224459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.224459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.224459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.224459] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd already deleted. [ 842.224459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.285982] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.285982] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-285" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.285982] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-285" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.286380] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-285" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.286790] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.287050] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.287050] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.287184] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.288011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.288011] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.288011] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.288011] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.288011] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.288011] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.288011] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.288454] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.309155] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.309236] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.310024] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.310024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-285" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.310024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-2c5a097e-df1f-4550-a7c1-ece15da565e0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.310024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.310551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.310551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.310551] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c5a097e-df1f-4550-a7c1-ece15da565e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.400285] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.472617] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.506375] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.506476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.506523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.506745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.506856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.507083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.507280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.507280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.507391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.507468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.507551] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3a32291-0504-4a58-83e8-3f2c4277ee9f already deleted. [ 842.507627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3a32291-0504-4a58-83e8-3f2c4277ee9f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.592464] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 842.592704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.724483] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 493976fc-b155-4f7b-9564-bec8067e71bd: rpc.has_security_group_logging(os_id): False [ 842.745288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.745288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.745288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.745288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.745659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.745964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.745964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.746065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.746197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.746296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.746386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd is going to be created. [ 842.765304] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd], does not exist path=[/infra/domains/default/groups/493976fc-b155-4f7b-9564-bec8067e71bd]."\n}' [ 842.765655] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd [ 842.765655] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 842.803468] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.803666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.803747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.803985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.805014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.805283] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.805406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.805474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.805687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.805760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.805908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.806026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.806091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.806203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.806284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.806374] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 493976fc-b155-4f7b-9564-bec8067e71bd is going to be created. [ 842.812964] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.813138] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.813196] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.813456] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.813598] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.813741] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 2c5a097e-df1f-4550-a7c1-ece15da565e0 not found, creating... [ 842.813989] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.814890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.814890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.814890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.814890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.814890] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.815204] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.815204] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.815656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.815656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.815786] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 2c5a097e-df1f-4550-a7c1-ece15da565e0 is going to be created. [ 842.836206] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd], does not exist path=[/infra/domains/default/groups/493976fc-b155-4f7b-9564-bec8067e71bd]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd [ 842.836339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-493976fc-b155-4f7b-9564-bec8067e71bd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.836584] env[65353]: Traceback (most recent call last): [ 842.836636] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 842.836636] env[65353]: return func(*args, **kwargs) [ 842.836636] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 842.836636] env[65353]: res.raise_for_status() [ 842.836636] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 842.836636] env[65353]: raise HTTPError(http_error_msg, response=self) [ 842.836636] env[65353]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd [ 842.836636] env[65353]: During handling of the above exception, another exception occurred: [ 842.836636] env[65353]: Traceback (most recent call last): [ 842.836636] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 842.836636] env[65353]: listener.cb(fileno) [ 842.836636] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 842.836636] env[65353]: result = function(*args, **kwargs) [ 842.837118] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 842.837118] env[65353]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 842.837118] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 842.837118] env[65353]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 842.837118] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 842.837118] env[65353]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 842.837118] env[65353]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 842.837118] env[65353]: res.raise_for_status() [ 842.837118] env[65353]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 842.837118] env[65353]: raise HTTPError(http_error_msg, response=self) [ 842.837118] env[65353]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/493976fc-b155-4f7b-9564-bec8067e71bd [ 842.837118] env[65353]: Removing descriptor: 12 [ 842.842756] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.843088] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.843324] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.843625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.843863] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.844151] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.903020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.975959] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.976329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.976329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.976468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.976561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.976615] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 843.010539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.010816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.010883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.011292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.011496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.024026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 843.404648] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.404824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.404921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.405112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.405198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.405293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 843.441914] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.441914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.442182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.442327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.442522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.455645] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 843.562713] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-06334de6-2667-4c9b-9ab5-bf76c76dcc38 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 843.562877] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-06334de6-2667-4c9b-9ab5-bf76c76dcc38 service nova] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 843.562923] env[65353]: INFO networking_nsxv3.common.synchronization [req-46804bd6-0f4b-436f-bb17-29440e100b56 req-06334de6-2667-4c9b-9ab5-bf76c76dcc38 service nova] Enqueued Resource ID: 2c5a097e-df1f-4550-a7c1-ece15da565e0 with Priority: HIGHEST for action port [ 843.563987] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_rules [ 843.563987] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 843.563987] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5a097e-df1f-4550-a7c1-ece15da565e0 with Priority: HIGHEST for action port [ 843.564676] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.564887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565749] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.565749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565749] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c5a097e-df1f-4550-a7c1-ece15da565e0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.565749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.566386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.566386] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c5a097e-df1f-4550-a7c1-ece15da565e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.576407] env[65353]: INFO networking_nsxv3.common.synchronization [req-1b1e7032-64e9-4f4d-8c56-d904a37972d0 req-bd311027-0669-4150-bfa7-45e98699e26a tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 843.576927] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 843.577253] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.577368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.577432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.577685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.577842] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.577944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.578010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.579738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.579863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.579970] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.615469] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97e4458-7809-406b-8b2f-b7ee556500c1 in Status: SUCCESS [ 843.615705] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 deletion is rescheduled due to dependency. [ 843.615830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.984281] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.986018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.986018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.986018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.986018] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.986018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.986018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.986494] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.986827] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.987241] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.987455] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.987645] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.987831] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.988042] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.988266] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.990053] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.009933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.009933] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.010095] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.010211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-282" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.010567] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-fe6d24a9-0f14-4db7-a827-564af698c0dd taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.010781] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.011430] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.011430] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.011430] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6d24a9-0f14-4db7-a827-564af698c0dd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.069600] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c5a097e-df1f-4550-a7c1-ece15da565e0 with status ACTIVE [ 844.069877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.070073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.070199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.070510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.070626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.070955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.071059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.071247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.071333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.071523] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.071642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.071679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.071806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.071906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.071981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c5a097e-df1f-4550-a7c1-ece15da565e0 is going to be updated. [ 844.082180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.082357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.082458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.082664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.082779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.082999] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.083189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.083480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.083480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.083562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.083623] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f70850f2-6628-4be4-939e-95e5fadec74b already deleted. [ 844.083725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.094047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.094198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.094247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.094410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.094540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.094692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c5a097e-df1f-4550-a7c1-ece15da565e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.514988] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.515318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.515648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.517801] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.517801] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.517801] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port fe6d24a9-0f14-4db7-a827-564af698c0dd not found, creating... [ 844.517801] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.518257] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.518614] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.518984] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.519193] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.519567] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.519773] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.519956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.520224] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.520570] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.520795] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: fe6d24a9-0f14-4db7-a827-564af698c0dd is going to be created. [ 844.542474] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.542698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.542852] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.543090] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.543405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.543625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.688628] env[65353]: INFO networking_nsxv3.common.synchronization [req-a0da22e3-ebe4-43ae-bff3-c64b8ce80a63 req-33163742-664e-484d-bba5-aaa3f419228d tempest-ServerMetadataNegativeTestJSON-1440814636 tempest-ServerMetadataNegativeTestJSON-1440814636-project-member] Enqueued Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 844.689250] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGHEST for action security_group_members [ 844.689720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.689720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.689951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.690026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.690287] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.690287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.690535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.690535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.690634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.690634] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.034745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 845.035069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.035307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.035595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.035746] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.035876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.035923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.036081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.036163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.036314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.036404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.036485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.036544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.036715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.036817] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.036927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.036965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.037107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.037177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.037264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.037352] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.038241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.038378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.038525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.038664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.038761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.039140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.039255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.039364] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.193361] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.193542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.193689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.193834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.219611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.219611] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.219852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.219852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.219924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.223026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.223026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d is going to be updated. [ 845.249446] env[65353]: INFO networking_nsxv3.common.synchronization [req-1b1e7032-64e9-4f4d-8c56-d904a37972d0 req-922f4153-3cde-48b5-93fb-9e1fbcb480ac service nova] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 845.249619] env[65353]: INFO networking_nsxv3.common.synchronization [req-1b1e7032-64e9-4f4d-8c56-d904a37972d0 req-922f4153-3cde-48b5-93fb-9e1fbcb480ac service nova] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 845.249752] env[65353]: INFO networking_nsxv3.common.synchronization [req-1b1e7032-64e9-4f4d-8c56-d904a37972d0 req-922f4153-3cde-48b5-93fb-9e1fbcb480ac service nova] Enqueued Resource ID: fe6d24a9-0f14-4db7-a827-564af698c0dd with Priority: HIGHEST for action port [ 845.251118] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.251320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.251364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.252027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.252211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.254126] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_rules [ 845.254329] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 845.254443] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6d24a9-0f14-4db7-a827-564af698c0dd with Priority: HIGHEST for action port [ 845.254755] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.254866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.255736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.256836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.256923] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.257873] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.257988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.258439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258884] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.259018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.259018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.259146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.259227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.259323] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.260705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe6d24a9-0f14-4db7-a827-564af698c0dd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.260897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.260897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.261097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.261134] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6d24a9-0f14-4db7-a827-564af698c0dd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.272301] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: IN_PROGRESS for 2s [ 845.467607] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 845.467876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.468072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.468413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.468563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.468709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.469342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.469547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.469645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.469781] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.541248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 845.544758] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.560710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.561167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.583711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.584060] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.584358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.584611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.584611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.584756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.584915] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.585105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.585105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.585304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.585304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.585447] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.585529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.585591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.585728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.585799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.585883] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 845.652857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.653018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.653094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.653365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.653512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.667529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 845.761117] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.763217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.763625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.765028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe6d24a9-0f14-4db7-a827-564af698c0dd with status ACTIVE [ 845.765028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.765028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.765761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.765761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.765761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.765761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.765761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.766326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.766326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.766326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.766326] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.766326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.766530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.766530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.766604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.766662] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe6d24a9-0f14-4db7-a827-564af698c0dd is going to be updated. [ 845.797577] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.797728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.797786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.797993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.798148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.798311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe6d24a9-0f14-4db7-a827-564af698c0dd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.971972] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.045442] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.263317] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.474551] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.549964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.549964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.550811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.550811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.550811] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 846.592044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.592044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.592044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.592044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.592044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.601822] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 846.767430] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.767689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.767823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.767942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.768062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.768141] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f70850f2-6628-4be4-939e-95e5fadec74b is going to be created. [ 846.802369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.802534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.802576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.802968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.803068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.815669] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: UNINITIALIZED for 2s [ 846.980093] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.980277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.980277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.980498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.980498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.980498] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 847.009981] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.009981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.009981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.010255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.010255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.021021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 847.284212] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d in Status: SUCCESS [ 847.284577] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d deletion is rescheduled due to dependency. [ 847.284577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.685945] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 847.686294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.686552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.686788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.686938] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.876817] env[65353]: INFO networking_nsxv3.common.synchronization [req-8de05064-ccfa-4247-83a3-e7cad29e04ca req-e342a2de-1725-4453-a8b8-ff6512b21d39 tempest-AttachInterfacesV270Test-707008197 tempest-AttachInterfacesV270Test-707008197-project-member] Enqueued Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 847.877774] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9972817-ff77-432f-a5cd-8388f88bd29a with Priority: HIGHEST for action security_group_members [ 847.878141] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9972817-ff77-432f-a5cd-8388f88bd29a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.878271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.878335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.878538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.878691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.878788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.878845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.878989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.879100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.879197] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9972817-ff77-432f-a5cd-8388f88bd29a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.074648] env[65353]: INFO networking_nsxv3.common.synchronization [req-cf9124e9-efc5-423d-b3ee-7107da74df20 req-48875766-815a-4fd8-b794-4fa4f39d19d6 tempest-ListImageFiltersTestJSON-1125268538 tempest-ListImageFiltersTestJSON-1125268538-project-member] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 848.076181] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGHEST for action security_group_members [ 848.076181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.076181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.076181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.076584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.076584] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.076584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.076584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.076752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.077505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.077505] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.189469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.189664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.382040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.382040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.382040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.382467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.402430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.402692] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.402810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.402876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.403093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.403252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.403354] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9972817-ff77-432f-a5cd-8388f88bd29a is going to be updated. [ 848.429574] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.429732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.429788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.429987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.430146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.439123] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: IN_PROGRESS for 2s [ 848.579579] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.579737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.579809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.580168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.601267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.601607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.601750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.601798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.602367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.602367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.602367] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be updated. [ 848.618701] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 848.618701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.618701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.618896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.619074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.619200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.619247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.620448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.620448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.620448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.620448] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.636284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.636284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.636284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.636284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.636602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.647562] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: IN_PROGRESS for 2s [ 848.844163] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: SUCCESS [ 848.844447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.844714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.844941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.845156] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.845291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.845366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.845520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.845600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.845662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.845759] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.034576] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 849.034815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.034997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.035236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.035432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.035550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.035616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.035924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.035924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.035924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.036057] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.036953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.037101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.037262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.037367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.037413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.037553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.038708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.038708] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.123992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.124385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.124385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.124565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.124565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.124697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.124828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.124879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.124930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.125012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.125166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.125259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.125315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.125453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.125751] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.125937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.125937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.126120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.126225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.126373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.126475] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.348506] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.539861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.539861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.540281] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.631324] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a6a2db-7d02-4b39-8d52-74d0e645bfea: rpc.has_security_group_logging(os_id): False [ 849.653171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.653171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.653171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.653171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.653171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.653171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.653700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.653700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.653700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.653700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.653957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.653957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.653957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.654155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.654292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.654483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.654582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.654634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.654776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.654846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.654929] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 849.720331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.720331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.720331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.720331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.720331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.740427] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 849.852023] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f70850f2-6628-4be4-939e-95e5fadec74b: rpc.has_security_group_logging(os_id): False [ 849.874662] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.874866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.874866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.875135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.875235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.875427] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.875538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.875642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.875772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.875856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.876019] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f70850f2-6628-4be4-939e-95e5fadec74b is going to be created. [ 849.956029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.956215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.956265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.956476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.956666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.978712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: IN_PROGRESS for 2s [ 850.042377] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.450558] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9972817-ff77-432f-a5cd-8388f88bd29a in Status: SUCCESS [ 850.450905] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9972817-ff77-432f-a5cd-8388f88bd29a deletion is rescheduled due to dependency. [ 850.451078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9972817-ff77-432f-a5cd-8388f88bd29a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.544995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.545401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.545401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.545589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.545826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.546042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 850.577706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.577706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.577933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.577974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.578134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.588358] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 850.659119] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 in Status: SUCCESS [ 850.659461] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 deletion is rescheduled due to dependency. [ 850.659598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.759831] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 851.760231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.994738] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: SUCCESS [ 851.994738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.601162] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 852.601460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.601634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.601844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.602122] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.602341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.602341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.602468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.602527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.602611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.602772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.602863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.602918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.603085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.603254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.603352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.603406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.603554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.603620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.603695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.603785] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.078364] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.078364] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 853.106199] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5: rpc.has_security_group_logging(os_id): False [ 853.129020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.129020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.129020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.129020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.152021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.152021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.152021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.152021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.152635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.152635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.152635] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 853.232165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.232165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.232165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.232165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.232165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.246607] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 853.862995] env[65353]: INFO networking_nsxv3.common.synchronization [req-d3317534-f9a2-42d2-9868-c0aaf81ba854 req-3da3974b-f0ff-44a3-8a65-363ccca0d997 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 853.869610] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 853.869610] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.869610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.869610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.869900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.869900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.869981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.869981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.870140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.870215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.870315] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.245221] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.245560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.245560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.245879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.246159] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.246317] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.246432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.246672] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.246839] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.247108] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.247250] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.247389] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.247530] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.247686] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.247808] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.247948] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.271267] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.271769] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.271927] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.272153] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.272794] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-aace172d-53be-4a84-9a36-bf5d8a6b47d1 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.273016] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.273392] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.276974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.276974] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aace172d-53be-4a84-9a36-bf5d8a6b47d1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.374151] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.374472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.374472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.374624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.395636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.395900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.396030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.396099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.396293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.396378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.396466] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 854.421593] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.421593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.421593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.421798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.421798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.431561] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 854.780567] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.780940] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.781545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.781944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.782321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.782539] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port aace172d-53be-4a84-9a36-bf5d8a6b47d1 not found, creating... [ 854.783045] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.783360] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.783794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.784145] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.784340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.784752] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.784994] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.785197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.785458] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.785687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.785868] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: aace172d-53be-4a84-9a36-bf5d8a6b47d1 is going to be created. [ 854.811007] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.811376] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.811516] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.811792] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.812037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.812289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.273552] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 855.273842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.273986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.274365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.274550] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.537729] env[65353]: INFO networking_nsxv3.common.synchronization [req-d3317534-f9a2-42d2-9868-c0aaf81ba854 req-6751d4db-7b57-4016-ba0d-6cb1e6017e0c service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 855.537900] env[65353]: INFO networking_nsxv3.common.synchronization [req-d3317534-f9a2-42d2-9868-c0aaf81ba854 req-6751d4db-7b57-4016-ba0d-6cb1e6017e0c service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 855.541075] env[65353]: INFO networking_nsxv3.common.synchronization [req-d3317534-f9a2-42d2-9868-c0aaf81ba854 req-6751d4db-7b57-4016-ba0d-6cb1e6017e0c service nova] Enqueued Resource ID: aace172d-53be-4a84-9a36-bf5d8a6b47d1 with Priority: HIGHEST for action port [ 855.541075] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 855.541075] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 855.541075] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace172d-53be-4a84-9a36-bf5d8a6b47d1 with Priority: HIGHEST for action port [ 855.541075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.541075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.541075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.541075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.541075] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.541818] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.541818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.541896] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aace172d-53be-4a84-9a36-bf5d8a6b47d1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.542040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.542085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.542733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.542733] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aace172d-53be-4a84-9a36-bf5d8a6b47d1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.780544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.780544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.780544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.780764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.780935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.781051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.781120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.781301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.781394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.781484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.781574] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.042438] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.042582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.046063] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aace172d-53be-4a84-9a36-bf5d8a6b47d1 with status ACTIVE [ 856.046276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.046404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.046487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.046672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.046769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.046958] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.047096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.047180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.047301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.047376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.047558] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.047651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.047695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.047833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.047899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.047984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aace172d-53be-4a84-9a36-bf5d8a6b47d1 is going to be updated. [ 856.073348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.073348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.073348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.073348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.073348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.073348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aace172d-53be-4a84-9a36-bf5d8a6b47d1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.286435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.286823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.286966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.287280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.290045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.290045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.290045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.290045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.290045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.299985] env[65353]: INFO networking_nsxv3.common.synchronization [req-4249156b-1772-4ce0-a1fe-bd2d307da7dd req-291345b6-9c95-44a1-90d2-a5c548461c4b tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 856.300977] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 856.305738] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.305902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.305967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.306202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.306388] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.306488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.306562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.306804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.306804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.306913] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.444771] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 856.444771] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 856.444771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.444771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.444771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.444771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.444771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.445280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.446669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.446844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.447036] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.792652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5: rpc.has_security_group_logging(os_id): False [ 856.809962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.810123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.810188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.810460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.812263] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.812363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.834444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.834922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.834922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.835124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.835700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.835700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.835700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be updated. [ 856.837032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.837032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.837032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.837190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.837268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.837303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.837439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.837517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.837720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.837850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.837893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.838046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.838120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.838309] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.838460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.838460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.838603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.838682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.838747] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 856.875041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.875221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.875475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.875545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.875770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.886627] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 856.907826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.908024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.908110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.908275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.908422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.922522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 856.950887] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.452420] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.955400] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.955622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.955622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.955861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.955954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.956059] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 857.988867] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.989081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.989144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.989361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.989509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.999768] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 858.392815] env[65353]: INFO networking_nsxv3.common.synchronization [req-89200faa-830b-4732-9746-c3558dea1a43 req-422d6741-943f-4696-a32a-05bc106d5ae6 tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 858.393467] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 858.393869] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.395407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.395407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.395407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.395522] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.395641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.395706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.395916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.396012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.396135] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.567216] env[65353]: INFO networking_nsxv3.common.synchronization [req-89200faa-830b-4732-9746-c3558dea1a43 req-7612c05a-fcaf-4b1f-bca6-ed704d41246d tempest-ServersTestMultiNic-1262842792 tempest-ServersTestMultiNic-1262842792-project-member] Enqueued Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 858.568443] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 with Priority: HIGHEST for action security_group_members [ 858.568443] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.568443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.897771] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 858.897972] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 deletion is rescheduled due to dependency. [ 858.898109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.898360] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.936876] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 858.937803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.401145] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.906274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.906668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.906668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.906743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.907312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.907312] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 859.938031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.938179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.938247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.938503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.938654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.947954] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 860.010365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 860.010478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.010598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.010802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.010986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.011119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.011209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.011449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.011536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.011668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.011792] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.516293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.516293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.516293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.516658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.516870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.517070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.517767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.517962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.518076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.518203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.518423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.518423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.518523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.519985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.519985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.519985] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.022441] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef90e1f-f512-4c74-82f2-c918b64f5aee: rpc.has_security_group_logging(os_id): False [ 861.041487] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.041720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.041720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.041981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.042085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.042276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.042378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.042437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.042588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.042663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.042863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.042993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.043048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.043163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.043234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.043505] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.043625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.043690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.043836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.043909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.043989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 861.112422] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.112422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.112422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.112628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.112780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.126670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 861.184209] env[65353]: INFO networking_nsxv3.common.synchronization [req-95362791-3147-492e-b00f-73b056732a47 req-3269a6a8-a134-4f26-becc-3cc42089d462 tempest-ServerTagsTestJSON-147343378 tempest-ServerTagsTestJSON-147343378-project-member] Enqueued Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 861.184209] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 861.187928] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.189046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.189046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.189379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.189379] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.555171] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.555171] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-902" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.555171] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-902" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.555475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-902" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.558320] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.558320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.558320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.558320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.558320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.558320] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.558320] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.558320] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.558320] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.558320] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.558320] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.558911] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.598575] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.598575] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 861.598575] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.598575] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-902" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.600848] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.601549] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.601957] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.603034] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.603034] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.692561] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.692561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.692561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.692561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.692561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.692561] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.693630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.693630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.693630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.693630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.693630] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 already deleted. [ 861.693630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.958561] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 861.958869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.959172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.959418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.959642] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.959792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.959863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.960055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.960127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.960198] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.105464] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.105942] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.105942] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.106175] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.106303] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.106457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 not found, creating... [ 862.106748] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.106910] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.108142] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.108498] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.108657] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.109044] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.109228] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.109352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.109615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.109770] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.109926] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 is going to be created. [ 862.134697] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.135874] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.135874] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.135874] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.136195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.136309] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.462799] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.462942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.463028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.463332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.463443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.463574] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.463675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.463737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.463890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.463967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.464071] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 is going to be updated. [ 862.494432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.494432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.494432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.494432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.494432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.503201] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: IN_PROGRESS for 2s [ 862.857317] env[65353]: INFO networking_nsxv3.common.synchronization [req-95362791-3147-492e-b00f-73b056732a47 req-96669156-e520-4cf9-8272-19dfe6dbdbd6 service nova] Enqueued Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_rules [ 862.857317] env[65353]: INFO networking_nsxv3.common.synchronization [req-95362791-3147-492e-b00f-73b056732a47 req-96669156-e520-4cf9-8272-19dfe6dbdbd6 service nova] Enqueued Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 862.857517] env[65353]: INFO networking_nsxv3.common.synchronization [req-95362791-3147-492e-b00f-73b056732a47 req-96669156-e520-4cf9-8272-19dfe6dbdbd6 service nova] Enqueued Resource ID: 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 with Priority: HIGHEST for action port [ 862.858017] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_rules [ 862.858144] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 862.858239] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 with Priority: HIGHEST for action port [ 862.859128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.859264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.859346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.859658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.859749] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.860890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.860890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.860890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.861070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.861430] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.861430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.861430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.861639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.861639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.861821] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.862511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.862650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.862716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.862821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.862928] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.141415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 863.141772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.364963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.365162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.365292] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.366282] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 with status ACTIVE [ 863.366471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.366586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.366645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.366847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.366937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.367164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.367255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.367377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.367468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.367544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.368074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.368190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.368256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.368404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.368482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.368569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1 is going to be updated. [ 863.394093] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.394309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.394403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.394684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.394882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.395115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd46c2e-3a08-4ffe-8c78-e5f3dcad57b1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.429792] env[65353]: INFO networking_nsxv3.common.synchronization [None req-dd392c62-1f91-4bda-aa14-b337b53504a9 tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: ea3fb6df-3653-4c8a-ae89-529de264780c with Priority: HIGHEST for action security_group_rules [ 863.430991] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3fb6df-3653-4c8a-ae89-529de264780c with Priority: HIGHEST for action security_group_rules [ 863.431356] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea3fb6df-3653-4c8a-ae89-529de264780c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.431519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.431625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.432035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.432197] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea3fb6df-3653-4c8a-ae89-529de264780c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.516137] env[65353]: INFO networking_nsxv3.common.synchronization [None req-143a25b1-940a-4475-b5f6-9ef17c5098a4 tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: ea3fb6df-3653-4c8a-ae89-529de264780c with Priority: HIGHEST for action security_group_rules [ 863.517944] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3fb6df-3653-4c8a-ae89-529de264780c with Priority: HIGHEST for action security_group_rules [ 863.517944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea3fb6df-3653-4c8a-ae89-529de264780c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.517944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.872138] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.942734] env[65353]: INFO networking_nsxv3.common.synchronization [req-bd90cba7-0c4d-4730-96ff-1822a4b289bd req-dfdcd879-c51e-4b5b-8170-2e7e5a002e46 tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 863.943349] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 863.943948] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.943948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.943948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.944176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.944176] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.944306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.944366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.944506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.944593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.944685] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.956458] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.956618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.956704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.956895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.956979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.957144] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea3fb6df-3653-4c8a-ae89-529de264780c already deleted. [ 863.957201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.957317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.957566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.957566] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea3fb6df-3653-4c8a-ae89-529de264780c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.375176] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.375520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.375623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.375690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.375791] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 is going to be created. [ 864.398650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.398784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.398851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.399079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.399246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.408858] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: UNINITIALIZED for 2s [ 864.446401] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.482839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.482984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.483062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.483367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.483420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.483581] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea3fb6df-3653-4c8a-ae89-529de264780c already deleted. [ 864.483666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea3fb6df-3653-4c8a-ae89-529de264780c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.511595] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 in Status: SUCCESS [ 864.511765] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5 deletion is rescheduled due to dependency. [ 864.511839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.949011] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.451547] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.451865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.451865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.452091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.452190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.452291] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 865.489733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.490071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.490228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.490584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.490875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.500799] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 866.418941] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: SUCCESS [ 866.419185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.419354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.419640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.419893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.420018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.420084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.420235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.420323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.420382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.420493] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.923197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.923587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.923587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.923702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.925048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.925048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.925618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.925618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.925618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.925618] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.428174] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ff9462c-b088-43b8-bce6-23c663c231c4: rpc.has_security_group_logging(os_id): False [ 867.445955] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.446156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.446156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.446361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.446446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.446645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.446781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.446781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.446921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.446993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.447190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.447731] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.448079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.448331] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 is going to be created. [ 867.508872] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.509065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.509128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.509389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.509501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.511272] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 867.511484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521562] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: IN_PROGRESS for 2s [ 868.944513] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 868.944513] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 869.535445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: SUCCESS [ 869.535701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.903583] env[65353]: INFO networking_nsxv3.common.synchronization [req-86c7c84a-c311-49a6-9796-7da95e506349 req-b451e2eb-3897-47d7-a576-0e1c6d9133a4 tempest-ServersV294TestFqdnHostnames-598803872 tempest-ServersV294TestFqdnHostnames-598803872-project-member] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 873.904340] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 873.904890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.905200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.905309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.905645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.905855] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.905985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.906066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.906260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.906371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.906482] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.269964] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.270545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-557" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.270778] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-557" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.271260] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-557" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.271681] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.271867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.271991] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.272238] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.272382] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.272613] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.272717] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.272824] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.272926] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.273042] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.273160] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.273295] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.297028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.297211] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.297394] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.297659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-557" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.298112] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-ba8bce22-4995-4625-a8b0-1c7f1934c974 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.298445] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.298498] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.298880] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.299129] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8bce22-4995-4625-a8b0-1c7f1934c974',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.409145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.409252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.409252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.409469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.409563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.409767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.409865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.409926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.410087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.410163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.410243] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 already deleted. [ 874.410322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.802070] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.802341] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.802479] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.802792] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.802992] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.803201] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port ba8bce22-4995-4625-a8b0-1c7f1934c974 not found, creating... [ 874.803539] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.803732] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.803883] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.804185] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.804440] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.804787] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.805066] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.805235] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.805482] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.805627] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.805772] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: ba8bce22-4995-4625-a8b0-1c7f1934c974 is going to be created. [ 874.827983] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.828198] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.828321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.828585] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.828822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.829074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.543042] env[65353]: INFO networking_nsxv3.common.synchronization [req-86c7c84a-c311-49a6-9796-7da95e506349 req-25470214-16a0-479f-b724-2fb875a3c7e6 service nova] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 875.543598] env[65353]: INFO networking_nsxv3.common.synchronization [req-86c7c84a-c311-49a6-9796-7da95e506349 req-25470214-16a0-479f-b724-2fb875a3c7e6 service nova] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 875.543697] env[65353]: INFO networking_nsxv3.common.synchronization [req-86c7c84a-c311-49a6-9796-7da95e506349 req-25470214-16a0-479f-b724-2fb875a3c7e6 service nova] Enqueued Resource ID: ba8bce22-4995-4625-a8b0-1c7f1934c974 with Priority: HIGHEST for action port [ 875.545446] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_rules [ 875.546953] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 875.546953] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8bce22-4995-4625-a8b0-1c7f1934c974 with Priority: HIGHEST for action port [ 875.546953] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.546953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.546953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.546953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.546953] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.550212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.550212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.550212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.550525] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.551444] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8bce22-4995-4625-a8b0-1c7f1934c974 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.551626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.551730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.552292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.555597] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8bce22-4995-4625-a8b0-1c7f1934c974',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.980130] env[65353]: INFO networking_nsxv3.common.synchronization [req-2b2f001f-e1d1-4c9a-9c00-0d7e4695d99a req-84ed9e8a-c9b1-4f3b-9979-8b4058466520 tempest-ServerTagsTestJSON-147343378 tempest-ServerTagsTestJSON-147343378-project-member] Enqueued Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 875.980130] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGHEST for action security_group_members [ 875.980130] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.980130] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.980130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.981191] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.049912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.049912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.061741] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba8bce22-4995-4625-a8b0-1c7f1934c974 with status ACTIVE [ 876.061741] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.061741] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.061741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.066032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.066032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.066032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.066032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.066032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.066032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.066032] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba8bce22-4995-4625-a8b0-1c7f1934c974 is going to be updated. [ 876.070716] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.099877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.101372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.101580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.101956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.102239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.102558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8bce22-4995-4625-a8b0-1c7f1934c974" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.485320] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.485320] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.485320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.485704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.485704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.485793] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 is going to be updated. [ 876.517711] env[65353]: INFO networking_nsxv3.common.synchronization [req-120bbc08-b05d-4593-942b-7cbb66d653c3 req-58a0f8c7-9573-422e-8536-bdc819cf92da tempest-ServersNegativeTestJSON-1226471339 tempest-ServersNegativeTestJSON-1226471339-project-member] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 876.517711] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.517711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.517711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.518295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.518295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.519368] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 876.520170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.520170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.520170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.523621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.523621] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.523621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.523621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.523621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.523852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.523852] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.534336] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: IN_PROGRESS for 2s [ 876.572877] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.979312] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.979460] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.979683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.979785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.980077] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.980195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.980293] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.980500] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.980639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.980841] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.980981] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.981116] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.981160] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.981275] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.981343] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.981494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.000677] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.000852] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 877.001093] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.001185] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.001486] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-2394d618-f36b-4afc-9496-d24ce919c276 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.001669] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.001749] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.002771] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.002771] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2394d618-f36b-4afc-9496-d24ce919c276',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.026919] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.077583] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.077583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.077583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.077862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.077904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.078045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 is going to be created. [ 877.104971] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.105377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.105377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.105377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.106740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.116039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: UNINITIALIZED for 2s [ 877.505512] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.505823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.505979] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.506293] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.506494] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.506672] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 2394d618-f36b-4afc-9496-d24ce919c276 not found, creating... [ 877.506950] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.507144] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.507282] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.507562] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.507715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.509331] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.509823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.509972] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.510245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.510429] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.510608] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 2394d618-f36b-4afc-9496-d24ce919c276 is going to be created. [ 877.528186] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.533032] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.533032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.533032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.533032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.533352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.533455] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.031197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.031528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.031528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.031662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.031757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.031856] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 878.066499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.066499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.066499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.066719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.066877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.077213] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 878.263908] env[65353]: INFO networking_nsxv3.common.synchronization [req-120bbc08-b05d-4593-942b-7cbb66d653c3 req-43c253a6-2d57-4ba9-a9a2-54d4ca70c39c service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 878.264095] env[65353]: INFO networking_nsxv3.common.synchronization [req-120bbc08-b05d-4593-942b-7cbb66d653c3 req-43c253a6-2d57-4ba9-a9a2-54d4ca70c39c service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 878.264232] env[65353]: INFO networking_nsxv3.common.synchronization [req-120bbc08-b05d-4593-942b-7cbb66d653c3 req-43c253a6-2d57-4ba9-a9a2-54d4ca70c39c service nova] Enqueued Resource ID: 2394d618-f36b-4afc-9496-d24ce919c276 with Priority: HIGHEST for action port [ 878.264736] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 878.264872] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 878.264968] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2394d618-f36b-4afc-9496-d24ce919c276 with Priority: HIGHEST for action port [ 878.265752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.265874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.265969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.266151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.266235] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.267610] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.267610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.267880] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2394d618-f36b-4afc-9496-d24ce919c276 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.267970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.267970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.268244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.268335] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2394d618-f36b-4afc-9496-d24ce919c276',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.554745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 in Status: SUCCESS [ 878.554977] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 deletion is rescheduled due to dependency. [ 878.555378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.768965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.769139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.772553] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2394d618-f36b-4afc-9496-d24ce919c276 with status ACTIVE [ 878.772800] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.772934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.773011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.773237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.773332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.773537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.773655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.773696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.773861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.773938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.774132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.774228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.774288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.774427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.774500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.774586] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2394d618-f36b-4afc-9496-d24ce919c276 is going to be updated. [ 878.797824] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.797969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.798066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.798261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.798402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.798577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2394d618-f36b-4afc-9496-d24ce919c276" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.128436] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: SUCCESS [ 879.128917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.129449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.129891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.130133] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.130305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.130378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.130584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.130670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.130889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.131458] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.271207] env[65353]: INFO networking_nsxv3.common.synchronization [req-b302d27a-b285-4a38-84bc-a4650fb9f193 req-ccce70df-8058-401c-813c-cdcb45d5ab6d tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 879.271207] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 879.271207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.271207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.271207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.271207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.271704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.271981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.272177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.272472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.272674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.272875] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.634081] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.698387] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.698610] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.698740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.699045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.699463] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.699908] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.699908] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.700039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.700115] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.700328] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.701772] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.701772] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.701772] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.701944] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.702030] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.702165] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.726884] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.727170] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.727332] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.727521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.727943] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-7c15360d-e464-40a1-8ab0-2b6090a58c83 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.728250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.728368] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.729259] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.729469] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c15360d-e464-40a1-8ab0-2b6090a58c83',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.776084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.776084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.776084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.776084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.776084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.778100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.778100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.778100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.778100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.778100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.778100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 already deleted. [ 879.778100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.090296] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 880.090749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.090749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.090930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.091087] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.091202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.091269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.091404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.091515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.091608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.136387] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 357b71ae-4236-49a4-9cb3-5cec4c42e443: rpc.has_security_group_logging(os_id): False [ 880.145348] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b6d3267e-cd96-4af2-8267-f97a57688625 None None] Enqueued Resource ID: f0f4d519-f250-41e8-8c2d-920651bb0906 with Priority: HIGHEST for action port [ 880.146427] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f4d519-f250-41e8-8c2d-920651bb0906 with Priority: HIGHEST for action port [ 880.146969] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0f4d519-f250-41e8-8c2d-920651bb0906 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.147263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0f4d519-f250-41e8-8c2d-920651bb0906" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.147446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0f4d519-f250-41e8-8c2d-920651bb0906" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.147829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0f4d519-f250-41e8-8c2d-920651bb0906" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.148028] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0f4d519-f250-41e8-8c2d-920651bb0906',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.158025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.158025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.158025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.158025] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 is going to be created. [ 880.220024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.220024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.220024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.220024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.220024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.235024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.235024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 7c15360d-e464-40a1-8ab0-2b6090a58c83 not found, creating... [ 880.235024] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.235024] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.235550] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.235550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.235550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.235786] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.236032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.236277] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 7c15360d-e464-40a1-8ab0-2b6090a58c83 is going to be created. [ 880.237981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: IN_PROGRESS for 2s [ 880.255968] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.256457] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.256907] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.257289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.257617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.257939] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.593744] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.651435] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0f4d519-f250-41e8-8c2d-920651bb0906 [ 880.651696] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.651850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.651897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.652131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.652245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.652316] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0f4d519-f250-41e8-8c2d-920651bb0906 already deleted. [ 880.652394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0f4d519-f250-41e8-8c2d-920651bb0906" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.034368] env[65353]: INFO networking_nsxv3.common.synchronization [req-b302d27a-b285-4a38-84bc-a4650fb9f193 req-bb7e5f6b-3118-4b9f-b868-e6611346be2d service nova] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_rules [ 881.034543] env[65353]: INFO networking_nsxv3.common.synchronization [req-b302d27a-b285-4a38-84bc-a4650fb9f193 req-bb7e5f6b-3118-4b9f-b868-e6611346be2d service nova] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 881.034709] env[65353]: INFO networking_nsxv3.common.synchronization [req-b302d27a-b285-4a38-84bc-a4650fb9f193 req-bb7e5f6b-3118-4b9f-b868-e6611346be2d service nova] Enqueued Resource ID: 7c15360d-e464-40a1-8ab0-2b6090a58c83 with Priority: HIGHEST for action port [ 881.034931] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_rules [ 881.035066] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 881.035282] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15360d-e464-40a1-8ab0-2b6090a58c83 with Priority: HIGHEST for action port [ 881.035957] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.035957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.035957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.036216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.036216] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.037037] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.037441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.037441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.037441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.037650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.037650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.037789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.039706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.039706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.039706] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.039706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c15360d-e464-40a1-8ab0-2b6090a58c83 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.039706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.039706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.039706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.039706] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c15360d-e464-40a1-8ab0-2b6090a58c83',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.095860] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.541244] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.541244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.541686] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.542565] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c15360d-e464-40a1-8ab0-2b6090a58c83 with status ACTIVE [ 881.542771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.542893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.543035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.543209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.543300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.543535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.543677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.543677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.543841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.543916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.545317] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.545317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.545317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.545317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.545317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.545317] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c15360d-e464-40a1-8ab0-2b6090a58c83 is going to be updated. [ 881.581994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.582230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.582230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.582462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.582719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.582887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c15360d-e464-40a1-8ab0-2b6090a58c83" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.601024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.601239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.601401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.601670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.601792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.601900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 881.651488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.652062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.652062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.652062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.652062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.683027] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 882.047408] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.170051] env[65353]: INFO networking_nsxv3.common.synchronization [req-ef420518-1e1a-4c31-977c-b872f429df2c req-1212e7e6-f6b1-4870-882c-40743439a540 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 882.170829] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 882.172029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.172029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.172029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.172029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.172295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.172524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.172635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.172948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.173102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.173263] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.250776] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: SUCCESS [ 882.251035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.549952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.549952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.549952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.550472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.550472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.550472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be created. [ 882.605114] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.605266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.605337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.605570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.605728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.623519] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: UNINITIALIZED for 2s [ 882.632616] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.632616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-920" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.632616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-920" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.632616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-920" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.632616] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.633052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.633052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.633125] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.633529] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.633529] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.633630] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.633667] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.633880] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.633880] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.633998] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.635082] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.672513] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.672702] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.672802] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.672968] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-920" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673305] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673625] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673987] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.674113] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4a99e5-0c73-460b-a9c6-88bd9a4554e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.677654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.677839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.677889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.678297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.678445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.678627] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.678720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.678782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.678967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.679046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.679134] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae already deleted. [ 882.679210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.691853] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0d7c2a12-09d4-43ea-b1b1-79a7176a6a22 None None] Enqueued Resource ID: 720b7c0b-c121-4e9d-b070-eb7df4b32950 with Priority: HIGHEST for action port [ 882.692477] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 720b7c0b-c121-4e9d-b070-eb7df4b32950 with Priority: HIGHEST for action port [ 882.693322] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-720b7c0b-c121-4e9d-b070-eb7df4b32950 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.693503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-720b7c0b-c121-4e9d-b070-eb7df4b32950" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.693576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-720b7c0b-c121-4e9d-b070-eb7df4b32950" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.693848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-720b7c0b-c121-4e9d-b070-eb7df4b32950" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.693926] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('720b7c0b-c121-4e9d-b070-eb7df4b32950',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.179510] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.179510] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.179784] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.180056] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.180195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.180466] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 not found, creating... [ 883.181370] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.181370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.181370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.181370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.181580] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.182668] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.182668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.182668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.183157] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.183157] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.183651] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 is going to be created. [ 883.197284] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 720b7c0b-c121-4e9d-b070-eb7df4b32950 [ 883.197687] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.197844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.197922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.198212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.198306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.202026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:720b7c0b-c121-4e9d-b070-eb7df4b32950 already deleted. [ 883.202026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-720b7c0b-c121-4e9d-b070-eb7df4b32950" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.206062] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.206215] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.206360] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.206650] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.206868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.207098] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.693494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 883.693829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.693878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.697919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.698183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.698343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.698421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.698618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.698710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.698799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.698894] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.948885] env[65353]: INFO networking_nsxv3.common.synchronization [req-ef420518-1e1a-4c31-977c-b872f429df2c req-740d8999-ff4f-4b9e-bddd-c2bb481af052 service nova] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 883.949070] env[65353]: INFO networking_nsxv3.common.synchronization [req-ef420518-1e1a-4c31-977c-b872f429df2c req-740d8999-ff4f-4b9e-bddd-c2bb481af052 service nova] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 883.949212] env[65353]: INFO networking_nsxv3.common.synchronization [req-ef420518-1e1a-4c31-977c-b872f429df2c req-740d8999-ff4f-4b9e-bddd-c2bb481af052 service nova] Enqueued Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 883.949442] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 883.949575] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 883.949683] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 883.950255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.950439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.950439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.950663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.950745] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.951654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.951759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.951838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.952057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.953516] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.953516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.953516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.953516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.953516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.953516] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.953835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.953835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.953835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.954041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.954041] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4a99e5-0c73-460b-a9c6-88bd9a4554e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.206065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.206065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.206065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.206065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.211092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.211092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.211092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.211092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.211449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.211449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.211449] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.211616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.211616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.211870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.211946] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.212063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.212063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.212253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.212344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.212424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.212498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.456452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.456452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.457902] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.458705] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with status ACTIVE [ 884.458902] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.459453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.459453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.459453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.459453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.459823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.459907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.459907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.460626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.460626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.460626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.460626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.460626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.460974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.460974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.460974] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 is going to be updated. [ 884.503059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.503059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.503059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.503515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.503515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.503859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.635947] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 884.636266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.636407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.637935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.637935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.637935] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.717453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28dd6d0-e311-4f5d-a6ed-59453af2dcc0: rpc.has_security_group_logging(os_id): False [ 884.738122] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.738257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.738981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.738981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.761529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762176] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.762875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.762875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.762875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.763110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.763313] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.763541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.763657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.763909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.764067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.764349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.764537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.764642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.764884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.764978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.765095] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 884.856409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.856636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.856636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.856877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.857033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.875880] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 884.966144] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.143027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.143027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.143027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.143027] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.143027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.144179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.144179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.144179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.144179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.144179] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.199149] env[65353]: INFO networking_nsxv3.common.synchronization [None req-45e38443-20be-4559-9e95-780302bfafa1 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 885.200117] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 885.200735] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.200990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.201173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.201619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.201825] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.465721] env[65353]: INFO networking_nsxv3.common.synchronization [None req-da432c49-c758-4504-bb71-70895c67d6a3 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 885.466259] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 885.466595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.466701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.469212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.469503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.469628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.469896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.470035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.470161] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be created. [ 885.494704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.495937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.496158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.496454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.496570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.514165] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: UNINITIALIZED for 2s [ 885.646404] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6201df91-3340-45fd-8fb5-eb672e417941: rpc.has_security_group_logging(os_id): False [ 885.668743] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.668900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.668979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.669436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.669436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.669436] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.669667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.669667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.669773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.669823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.669985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.670089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.670147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.670273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671632] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.671632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.671632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671632] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be created. [ 885.725873] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.726181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.726181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.726435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.726533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.726640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 069ced97-9b0a-489d-acf5-0da342604329 already deleted. [ 885.726734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.726908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.727113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.727200] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.733012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.733331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.733331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.733577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.733775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.749203] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: IN_PROGRESS for 2s [ 885.793431] env[65353]: INFO networking_nsxv3.common.synchronization [req-b2448b4b-6376-41a3-8f29-ef99a1604ea0 req-36c68dd5-d768-4bfe-bcb3-d01da618d4ee tempest-ListServerFiltersTestJSON-1326299931 tempest-ListServerFiltersTestJSON-1326299931-project-member] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 885.794183] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGHEST for action security_group_members [ 885.794909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.795156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.795156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.795325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.795544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.795642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.795642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.795763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.796077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.796077] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.251371] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.251559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.251663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.251909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.252111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.252721] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 069ced97-9b0a-489d-acf5-0da342604329 already deleted. [ 886.252899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.299784] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.300261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.300338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.322354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.322354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.322354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.322354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.322354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.322354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.322354] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be updated. [ 886.350228] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.350426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.350514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.350781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.350979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.361028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: IN_PROGRESS for 2s [ 886.557552] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7bf85d0-33f3-42d9-917e-8e3ea4c27176 req-dc397494-724d-4c0f-838d-a2667fa88a93 tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 886.558142] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 886.559454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.559454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.559454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.559820] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.892757] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 886.893140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.063800] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.063998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.064062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.064944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.064944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.064944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.064944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.064944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.065220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.065220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.065220] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be updated. [ 887.090594] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.090766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.090766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.090949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.091105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.100752] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 887.477179] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.477408] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.477539] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.478015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.478275] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.479231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.479231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.479231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.479231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.479231] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.479231] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.479531] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.479531] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.479531] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.479646] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.479751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.499074] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.499307] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.499420] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.499592] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-249" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.499935] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.500121] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.500241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.500559] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.500701] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.526734] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 887.526734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.526734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.526955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.527107] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.527260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.527260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.527425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.527548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.527596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.527698] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.768390] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 887.768834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.004031] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.004746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.004746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.004746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.004746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.005030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c not found, creating... [ 888.005698] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.005909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.006046] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.006307] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.006444] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.006822] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.007337] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.007503] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.007785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.007962] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.008136] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c is going to be created. [ 888.031444] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.033681] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.034063] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.034250] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.034756] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.035273] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.035706] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.371900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 in Status: SUCCESS [ 888.372151] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 deletion is rescheduled due to dependency. [ 888.373029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.539044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb2e509b-93a9-4dd4-864d-59f2d21a37ae: rpc.has_security_group_logging(os_id): False [ 888.562409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.562653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.562731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.562958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.563121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.563390] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.563529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.563601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.564781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.564781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.564781] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be created. [ 888.635475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.635707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.635707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.635958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.636157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.648496] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 2s [ 888.770180] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7bf85d0-33f3-42d9-917e-8e3ea4c27176 req-aa68e6c7-c362-4386-a402-c0d3a3209e34 service nova] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 888.770244] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7bf85d0-33f3-42d9-917e-8e3ea4c27176 req-aa68e6c7-c362-4386-a402-c0d3a3209e34 service nova] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 888.770383] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7bf85d0-33f3-42d9-917e-8e3ea4c27176 req-aa68e6c7-c362-4386-a402-c0d3a3209e34 service nova] Enqueued Resource ID: 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c with Priority: HIGHEST for action port [ 888.771862] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_rules [ 888.772051] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 888.772122] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c with Priority: HIGHEST for action port [ 888.772420] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.772546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.772613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.772827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.772907] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.773851] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.773956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.774185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.774350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.774350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.774509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.774612] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.112933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 889.112933] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 deletion is rescheduled due to dependency. [ 889.113312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.113312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.113395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.113640] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.113769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.113834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.114018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.114100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.114155] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.277331] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c with status ACTIVE [ 889.279383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.279383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.279383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.279383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.279383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c is going to be updated. [ 889.284499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.284643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.307722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.307878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.307943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.308188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.308359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.308494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a9d0cf0-4fb5-42c1-88c5-ade5257aff1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.617945] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.119013] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.622695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.622797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.622841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.623075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.623161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.623258] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be updated. [ 890.657030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.657218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.657265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.657454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.657610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.663567] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 890.663824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.669560] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 891.009145] env[65353]: INFO networking_nsxv3.common.synchronization [None req-eb87c689-dddb-43b4-a494-605374438731 None None] Enqueued Resource ID: f7d89b36-7da3-4bb0-9f91-77eaeb7bca94 with Priority: HIGHEST for action port [ 891.009145] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d89b36-7da3-4bb0-9f91-77eaeb7bca94 with Priority: HIGHEST for action port [ 891.009145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d89b36-7da3-4bb0-9f91-77eaeb7bca94 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.009145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d89b36-7da3-4bb0-9f91-77eaeb7bca94" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.009145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d89b36-7da3-4bb0-9f91-77eaeb7bca94" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.013194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d89b36-7da3-4bb0-9f91-77eaeb7bca94" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.013194] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d89b36-7da3-4bb0-9f91-77eaeb7bca94',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.519590] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7d89b36-7da3-4bb0-9f91-77eaeb7bca94 [ 891.520117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.520265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.520376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.520723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.520882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.521053] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7d89b36-7da3-4bb0-9f91-77eaeb7bca94 already deleted. [ 891.521199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d89b36-7da3-4bb0-9f91-77eaeb7bca94" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.712069] env[65353]: INFO networking_nsxv3.common.synchronization [req-e926c324-f985-4df0-88c3-c7621dd42a09 req-17cc0ea5-d2ff-42b6-915c-5594d7a99acd tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 891.712800] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 891.714383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.714546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.714546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.715095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.715095] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.715652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.715758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.716986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.716986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.716986] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.220234] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.220450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.220544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.220816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.247330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.247723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.247916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.248033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.248678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.248678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.249152] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 892.285704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.285898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.285898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.286161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.286774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.297986] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 892.400679] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.400944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.401129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.401492] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.401778] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.402130] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.402853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.402853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.402853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.403011] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.403065] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.403182] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.403240] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.403341] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.403442] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.403592] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.424407] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.424595] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.424741] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.424944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.425290] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-b128c20f-edf8-4f34-92c6-c8c46a4d2741 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.425457] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.425576] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.425960] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.426124] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b128c20f-edf8-4f34-92c6-c8c46a4d2741',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.635406] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c10eb75b-8753-4fd2-abad-b6d5baadcfa3 None None] Enqueued Resource ID: 775036bb-9c53-4c9a-aa73-9da458d94c17 with Priority: HIGHEST for action port [ 892.636022] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775036bb-9c53-4c9a-aa73-9da458d94c17 with Priority: HIGHEST for action port [ 892.637925] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-775036bb-9c53-4c9a-aa73-9da458d94c17 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.637925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-775036bb-9c53-4c9a-aa73-9da458d94c17" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.637925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-775036bb-9c53-4c9a-aa73-9da458d94c17" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.637925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-775036bb-9c53-4c9a-aa73-9da458d94c17" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.637925] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775036bb-9c53-4c9a-aa73-9da458d94c17',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.680667] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 892.681413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.681868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.682143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.682679] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.682679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.682679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.683096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.683263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.683396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.683565] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.931125] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.931125] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.931125] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.932594] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.932823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.932908] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port b128c20f-edf8-4f34-92c6-c8c46a4d2741 not found, creating... [ 892.933207] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.933371] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.933483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.933803] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.933957] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.934333] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.934489] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.934611] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.934831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.934959] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.935107] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: b128c20f-edf8-4f34-92c6-c8c46a4d2741 is going to be created. [ 892.956556] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.956803] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.956926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.957211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.957436] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.957650] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.140189] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 775036bb-9c53-4c9a-aa73-9da458d94c17 [ 893.141076] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.141076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.141076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.141869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.141869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.141869] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:775036bb-9c53-4c9a-aa73-9da458d94c17 already deleted. [ 893.141869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-775036bb-9c53-4c9a-aa73-9da458d94c17" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188353] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.499438] env[65353]: INFO networking_nsxv3.common.synchronization [req-897dcbe3-b1fa-47de-af76-d39c12cf32eb req-b561f4df-99a7-44f3-a763-f7960807260d tempest-ServersNegativeTestJSON-1226471339 tempest-ServersNegativeTestJSON-1226471339-project-member] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 893.500063] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 893.500063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.500280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.500280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.500473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.500637] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.500750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.500825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.500974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.501147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.501276] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.691539] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 400ed73f-78cb-4aac-8a3b-e0415f1fbf19: rpc.has_security_group_logging(os_id): False [ 893.712316] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.712575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.712647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.712987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.713158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.713561] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.713761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.713847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.714447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.714447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.714630] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be updated. [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [req-e926c324-f985-4df0-88c3-c7621dd42a09 req-162df0fd-93e6-44ae-aad8-4b9748bcc874 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [req-e926c324-f985-4df0-88c3-c7621dd42a09 req-162df0fd-93e6-44ae-aad8-4b9748bcc874 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [req-e926c324-f985-4df0-88c3-c7621dd42a09 req-162df0fd-93e6-44ae-aad8-4b9748bcc874 service nova] Enqueued Resource ID: b128c20f-edf8-4f34-92c6-c8c46a4d2741 with Priority: HIGHEST for action port [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 893.728694] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b128c20f-edf8-4f34-92c6-c8c46a4d2741 with Priority: HIGHEST for action port [ 893.729654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.729819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.729900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.730154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.730273] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.732754] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.732906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.733259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b128c20f-edf8-4f34-92c6-c8c46a4d2741 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.733437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.733613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.735034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.735034] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b128c20f-edf8-4f34-92c6-c8c46a4d2741',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.782534] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.782770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.783146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.786074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.786074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.797053] env[65353]: INFO networking_nsxv3.common.synchronization [req-7c46b46a-152b-45aa-84f9-8f4c4256c376 req-77eec6ce-63f9-4a66-b957-8979f71ff939 tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 893.797597] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 893.798164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.798340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.798454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.798828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.799072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.799213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.799303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.799556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.799950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.803464] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.803464] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 894.004508] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.236607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.236912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.239438] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b128c20f-edf8-4f34-92c6-c8c46a4d2741 with status ACTIVE [ 894.239952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.239952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.239952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.240337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.240448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.240713] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.240780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.240879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.241090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.241201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.241695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.241695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.241695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.241890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.242017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.242145] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b128c20f-edf8-4f34-92c6-c8c46a4d2741 is going to be updated. [ 894.267843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.268182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.268322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.268419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.268560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.268757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b128c20f-edf8-4f34-92c6-c8c46a4d2741" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.305136] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.309731] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 894.309888] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e deletion is rescheduled due to dependency. [ 894.309993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.310149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.310382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.310565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.310687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.310745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.310965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.310965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.311069] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.509638] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.808716] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.814184] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.894790] env[65353]: INFO networking_nsxv3.common.synchronization [None req-65608d8f-2d57-4955-abd3-333b303a386c None None] Enqueued Resource ID: 1845059f-c899-4fa2-8091-b202f1e5e635 with Priority: HIGHEST for action port [ 894.895447] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845059f-c899-4fa2-8091-b202f1e5e635 with Priority: HIGHEST for action port [ 894.896877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1845059f-c899-4fa2-8091-b202f1e5e635 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.896877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1845059f-c899-4fa2-8091-b202f1e5e635" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.896877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1845059f-c899-4fa2-8091-b202f1e5e635" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.896877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1845059f-c899-4fa2-8091-b202f1e5e635" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.896877] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1845059f-c899-4fa2-8091-b202f1e5e635',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.013294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.013294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.013294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.013294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.013294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.013778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 895.067861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.068156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.068156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.068428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.068519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.110867] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 895.251716] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b8ea18c9-4a38-4b87-b204-20c3b3dfcfa9 None None] Enqueued Resource ID: 619b1098-04bd-400e-b7f5-2794dc49bd11 with Priority: HIGHEST for action port [ 895.252465] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619b1098-04bd-400e-b7f5-2794dc49bd11 with Priority: HIGHEST for action port [ 895.252714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-619b1098-04bd-400e-b7f5-2794dc49bd11 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.254228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-619b1098-04bd-400e-b7f5-2794dc49bd11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.254228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-619b1098-04bd-400e-b7f5-2794dc49bd11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.254228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-619b1098-04bd-400e-b7f5-2794dc49bd11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.254228] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619b1098-04bd-400e-b7f5-2794dc49bd11',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.311345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.311561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.311630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.311852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.311968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.312385] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 895.317130] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.345866] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.346070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.346177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.347573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.347858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.359636] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 895.401941] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1845059f-c899-4fa2-8091-b202f1e5e635 [ 895.401941] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.401941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.402181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.402265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.402437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.403045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1845059f-c899-4fa2-8091-b202f1e5e635 already deleted. [ 895.403045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1845059f-c899-4fa2-8091-b202f1e5e635" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.755411] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 619b1098-04bd-400e-b7f5-2794dc49bd11 [ 895.755646] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.755778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.755846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.756124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.756227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.756378] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:619b1098-04bd-400e-b7f5-2794dc49bd11 already deleted. [ 895.756481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-619b1098-04bd-400e-b7f5-2794dc49bd11" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.820030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.820431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.820431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.820532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.820567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.820666] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 895.822826] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 895.823043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.860370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.860567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.860605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.860808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.860958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.871163] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 897.097318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 897.097572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.369939] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 897.370320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.882220] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 897.882534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.882745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.883279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.883279] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.883449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.883449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.883679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.883789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.883919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.884333] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.388106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.388408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.388408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.388520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.388714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.388823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.388890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.389072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.389163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.389258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.389994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.390302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.390302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.390397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.390504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.390606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.390788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.390788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.393749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.393919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.897670] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e: rpc.has_security_group_logging(os_id): False [ 898.917499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.917685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.917756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.917955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.918241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.918317] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.918395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.918454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.918667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.918701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.918868] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.918962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.919049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.919184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.919393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.919451] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.919545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.919582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.919734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.919810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.919897] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 898.983516] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.983736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.983790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.984017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.984182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.999894] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 899.584364] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b2d72671-ccb3-44e1-9701-e00d027cfcb1 None None] Enqueued Resource ID: 45d5ecc6-87e6-486e-8781-601fef474af5 with Priority: HIGHEST for action port [ 899.586201] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d5ecc6-87e6-486e-8781-601fef474af5 with Priority: HIGHEST for action port [ 899.587693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-45d5ecc6-87e6-486e-8781-601fef474af5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.588017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45d5ecc6-87e6-486e-8781-601fef474af5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.588264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45d5ecc6-87e6-486e-8781-601fef474af5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.588687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45d5ecc6-87e6-486e-8781-601fef474af5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.589021] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45d5ecc6-87e6-486e-8781-601fef474af5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.092322] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45d5ecc6-87e6-486e-8781-601fef474af5 [ 900.092322] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.092478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.092478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.093372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.093372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.093372] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45d5ecc6-87e6-486e-8781-601fef474af5 already deleted. [ 900.093372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45d5ecc6-87e6-486e-8781-601fef474af5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.121662] env[65353]: INFO networking_nsxv3.common.synchronization [req-3cb669f1-a191-450d-800a-cd779bb00e56 req-a29126dc-e987-4fa5-95f4-28c034cb19ae tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 900.121662] env[65353]: INFO networking_nsxv3.common.synchronization [req-3cb669f1-a191-450d-800a-cd779bb00e56 req-a29126dc-e987-4fa5-95f4-28c034cb19ae tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 900.121802] env[65353]: INFO networking_nsxv3.common.synchronization [req-3cb669f1-a191-450d-800a-cd779bb00e56 req-a29126dc-e987-4fa5-95f4-28c034cb19ae tempest-SecurityGroupsTestJSON-111247810 tempest-SecurityGroupsTestJSON-111247810-project-member] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 900.125598] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGHEST for action security_group_members [ 900.125801] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGHEST for action security_group_members [ 900.125947] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGHEST for action security_group_members [ 900.126693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.126837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.126920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.127203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.127374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.127480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.127541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.127695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.127779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.127875] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.133695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.133695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.133695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.133695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.134123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.134123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.134123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.134217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.138023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.138023] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.138023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.138023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.138023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.138291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.138533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.138533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.138610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.139285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.139438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.139571] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.642182] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.642596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.642596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.642694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.644025] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.644154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.644383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.644473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.669879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.670776] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.670994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.671099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.671368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.671477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.671717] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be updated. [ 900.672800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.672991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.701657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.701985] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.702148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.702242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.702487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.702595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.702762] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be updated. [ 900.704087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.705083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.705083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.705083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.705083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.705083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.705327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.705327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.705327] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be updated. [ 900.715339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.715544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.715544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.715813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.715994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.724900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: IN_PROGRESS for 2s [ 900.740183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.740363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.740404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.740606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.741020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.742626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.742752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.742823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.742999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.743144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.757458] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: IN_PROGRESS for 2s [ 900.757458] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: IN_PROGRESS for 2s [ 901.020124] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 901.020124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.736111] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcebdf84-f874-4db4-b283-bda9c57166cf in Status: SUCCESS [ 902.736472] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf deletion is rescheduled due to dependency. [ 902.736656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.766652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea in Status: SUCCESS [ 902.766983] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea deletion is rescheduled due to dependency. [ 902.767125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.768591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b in Status: SUCCESS [ 902.768591] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b deletion is rescheduled due to dependency. [ 902.768591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.592680] env[65353]: INFO networking_nsxv3.common.synchronization [req-169fa63a-6cf3-47f7-910e-bab74d447f00 req-9c50eff0-1de1-485c-8301-34d80106abd0 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 903.593454] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 903.594184] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.599093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.599093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.599093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.599093] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.599093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.599093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.599629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.601889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.601889] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.006032] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.006032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.006032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.006032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.006032] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.006032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.006032] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.007100] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.007559] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.007909] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.008168] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.008490] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.009961] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.009961] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.009961] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.009961] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.037626] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.037841] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.037907] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.038134] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.039026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-42fc995d-cf21-40a3-a25b-453468a9df0b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.039026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.039026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.040538] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.040538] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42fc995d-cf21-40a3-a25b-453468a9df0b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.110090] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.110308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.110378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.110594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.110680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.110891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.110987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.111079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.111199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.111272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.111352] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 already deleted. [ 904.111437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.541491] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.541717] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.541846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.542170] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.542328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.542482] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 42fc995d-cf21-40a3-a25b-453468a9df0b not found, creating... [ 904.542740] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.542896] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.543027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.543243] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.543415] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.543758] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.543920] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.544398] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.544670] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.544858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.545008] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 42fc995d-cf21-40a3-a25b-453468a9df0b is going to be created. [ 904.570578] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.570859] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.570985] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.571499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.571856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.572227] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.257284] env[65353]: INFO networking_nsxv3.common.synchronization [req-169fa63a-6cf3-47f7-910e-bab74d447f00 req-19df56c7-57d9-416e-ad5e-40916799b713 service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 905.257521] env[65353]: INFO networking_nsxv3.common.synchronization [req-169fa63a-6cf3-47f7-910e-bab74d447f00 req-19df56c7-57d9-416e-ad5e-40916799b713 service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 905.257555] env[65353]: INFO networking_nsxv3.common.synchronization [req-169fa63a-6cf3-47f7-910e-bab74d447f00 req-19df56c7-57d9-416e-ad5e-40916799b713 service nova] Enqueued Resource ID: 42fc995d-cf21-40a3-a25b-453468a9df0b with Priority: HIGHEST for action port [ 905.258289] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 905.258393] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 905.258496] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42fc995d-cf21-40a3-a25b-453468a9df0b with Priority: HIGHEST for action port [ 905.258775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.258895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.258985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.259264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.259351] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.260714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.260939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.261167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.262812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.262812] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.262812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.262812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.262812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.262812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.262812] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.264150] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-42fc995d-cf21-40a3-a25b-453468a9df0b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.265246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.265246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.265246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.265246] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42fc995d-cf21-40a3-a25b-453468a9df0b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.761566] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.761758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.764622] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.766031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42fc995d-cf21-40a3-a25b-453468a9df0b with status ACTIVE [ 905.766031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.766192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.766192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.766417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.766553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.766690] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.766804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.766884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.767087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.767179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.767433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.767974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.767974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.767974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.767974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.767974] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42fc995d-cf21-40a3-a25b-453468a9df0b is going to be updated. [ 905.793125] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.793417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.793417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.793847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.793847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.793965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42fc995d-cf21-40a3-a25b-453468a9df0b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.042492] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca32b7c3-0d43-4ee5-b3c4-8fa9adaf8826 req-a36cb795-a91d-4a02-8fd1-6c92b0b56fb7 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 906.042588] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 906.042989] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.043164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.043299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.043654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.043794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.043902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.044303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.044303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.044303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.044409] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.266510] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.427709] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.427950] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.428082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.428353] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.428605] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.428815] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.428858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.429753] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.429753] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.429753] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.429893] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.429958] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.430054] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.430165] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.430266] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.430390] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.451047] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.451218] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.451352] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.451523] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.451982] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.452212] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.452338] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.452848] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.452934] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704e52ca-5ace-4db7-acf6-b5ac96e6b69e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.546745] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.769869] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.770116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.770202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.770453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.770521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.770620] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be created. [ 906.800045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.800045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.800045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.800045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.800045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.812315] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: UNINITIALIZED for 2s [ 906.957211] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.957211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.957211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.957211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.957211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.957211] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 704e52ca-5ace-4db7-acf6-b5ac96e6b69e not found, creating... [ 906.957488] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.957555] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.957656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.957890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.958062] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.958363] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.958529] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.958642] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.958868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.959037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.959181] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 704e52ca-5ace-4db7-acf6-b5ac96e6b69e is going to be created. [ 906.981277] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.981551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.981682] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.981980] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.982394] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.982673] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.048849] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.551603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.552035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.552035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.552154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.552610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.552610] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 907.595803] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.595990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.596050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.596262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.596414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.609335] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 907.688510] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca32b7c3-0d43-4ee5-b3c4-8fa9adaf8826 req-c388c7e3-a1f1-4e5c-a7cc-78524422de46 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 907.688510] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca32b7c3-0d43-4ee5-b3c4-8fa9adaf8826 req-c388c7e3-a1f1-4e5c-a7cc-78524422de46 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 907.688873] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca32b7c3-0d43-4ee5-b3c4-8fa9adaf8826 req-c388c7e3-a1f1-4e5c-a7cc-78524422de46 service nova] Enqueued Resource ID: 704e52ca-5ace-4db7-acf6-b5ac96e6b69e with Priority: HIGHEST for action port [ 907.689825] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 907.690262] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 907.690579] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e52ca-5ace-4db7-acf6-b5ac96e6b69e with Priority: HIGHEST for action port [ 907.691214] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.691469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.691621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.692334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.692752] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.694679] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.694790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.694986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.695104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.695165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.695351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.696242] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704e52ca-5ace-4db7-acf6-b5ac96e6b69e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.195626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.195776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.197170] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 704e52ca-5ace-4db7-acf6-b5ac96e6b69e with status ACTIVE [ 908.197444] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.197552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.197552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.197770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.197850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.198042] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.198137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.198196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.198354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.198422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.198602] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.198771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.198771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.198891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.198967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.199066] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 704e52ca-5ace-4db7-acf6-b5ac96e6b69e is going to be updated. [ 908.222607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.222908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.222988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.223516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.223516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.223516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704e52ca-5ace-4db7-acf6-b5ac96e6b69e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.485016] env[65353]: INFO networking_nsxv3.common.synchronization [req-8ce5fd0a-e7d8-4964-84ac-ab094d9e38dc req-373da508-8591-4595-93ae-fcbf7f45e57f tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 908.485016] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 908.485626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.485626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.485626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.485964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.486701] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.486701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.486701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.486906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.486934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.487092] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.824242] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 908.824242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.824242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.824242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.824242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.824242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.824242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.824891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.824891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.824891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.824891] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.989383] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.327160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.327160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.327373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.327483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.327651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.327746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.327813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.327991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.328094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.328182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.328326] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.328418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.328479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.328617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.328764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.328857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.328914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.329135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.329217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.329320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.329417] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.491985] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.620684] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 909.621135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.621135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.621346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.621492] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.621609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.621679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.621829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.621927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.622042] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.832796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 909.854276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.855831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.856045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.856396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.856578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.857074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.857226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.857504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.857829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.858053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.859068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.859068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.859068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.859068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.859068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.859355] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.859514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.859617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.859858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.859987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.860696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be created. [ 909.962750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.963291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.963291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.963437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.963711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.985934] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 909.998083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.998407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.998512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.998980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.998980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999085] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 910.042397] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.042598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.042670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.043858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.043858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.064083] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 910.130308] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.630598] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.134264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.134603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.134603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.134763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.134836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.134962] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 911.166816] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.166973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.167061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.167284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.167438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.177386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 911.999044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 911.999412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.073984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 912.074329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.256081] env[65353]: INFO networking_nsxv3.common.synchronization [req-ce0ad430-6fd8-42cb-90ed-4c3a67bc9f46 req-8ceba013-1207-49a7-bea1-94ecefca141c tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 912.256664] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 912.257927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.257927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.257927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.257927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.257927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.258248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.258248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.258248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.258326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.258351] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.760834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.761012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.761774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.761774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.761774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.761774] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.761774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.761774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.762117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.762117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.762192] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 069ced97-9b0a-489d-acf5-0da342604329 already deleted. [ 912.762231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.813428] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.813763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.813925] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.814372] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.814710] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.814900] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.814964] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.815234] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.815504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.815581] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.815694] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.815802] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.816455] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.816455] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.816455] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.816455] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.841101] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.841101] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.841101] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.841101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.841101] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-bbf669bd-98b8-4f3f-8bef-433ebef5550b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.841101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.841101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.841101] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.841101] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf669bd-98b8-4f3f-8bef-433ebef5550b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.189159] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 913.189595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.189959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.190365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.190461] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.190730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.190852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.191147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.191247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.191346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.191456] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.343722] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.344044] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.344261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.344644] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.344845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.345077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port bbf669bd-98b8-4f3f-8bef-433ebef5550b not found, creating... [ 913.345385] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.345549] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.345669] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.345906] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.346052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.346804] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.346804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.346804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.346804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.347294] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.347294] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: bbf669bd-98b8-4f3f-8bef-433ebef5550b is going to be created. [ 913.374259] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.374553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.374675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.375200] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.375468] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.375762] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.695588] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.695846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.695846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.696054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.696239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.696350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.696413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.696577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.696667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.696763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.696929] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.697108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.697154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.697288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.697510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.697594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.697719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.698308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.698308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.698416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.698526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.108034] env[65353]: INFO networking_nsxv3.common.synchronization [req-ce0ad430-6fd8-42cb-90ed-4c3a67bc9f46 req-c7fca85d-4e5c-44df-9c29-e63c5f1f7da9 service nova] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 914.108358] env[65353]: INFO networking_nsxv3.common.synchronization [req-ce0ad430-6fd8-42cb-90ed-4c3a67bc9f46 req-c7fca85d-4e5c-44df-9c29-e63c5f1f7da9 service nova] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 914.108597] env[65353]: INFO networking_nsxv3.common.synchronization [req-ce0ad430-6fd8-42cb-90ed-4c3a67bc9f46 req-c7fca85d-4e5c-44df-9c29-e63c5f1f7da9 service nova] Enqueued Resource ID: bbf669bd-98b8-4f3f-8bef-433ebef5550b with Priority: HIGHEST for action port [ 914.109434] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_rules [ 914.109518] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 914.109661] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf669bd-98b8-4f3f-8bef-433ebef5550b with Priority: HIGHEST for action port [ 914.109950] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.110100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.110173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.110426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.110526] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.112534] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.112749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.112795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.114578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.114578] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.114578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.114578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.114578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.114578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.114578] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.115021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf669bd-98b8-4f3f-8bef-433ebef5550b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.115021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.115021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.115278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.115322] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf669bd-98b8-4f3f-8bef-433ebef5550b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.205191] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef90e1f-f512-4c74-82f2-c918b64f5aee: rpc.has_security_group_logging(os_id): False [ 914.226704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.226844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.227189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.227267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.227297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.227508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.227627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.227717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.227894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.227975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.228226] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.228348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.228412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.229130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.229324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.229563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.229669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.229736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.230000] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.230000] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.230104] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 914.311192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.311461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.311760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.311986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.312211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.328156] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 914.613296] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.613296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.618907] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.620197] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbf669bd-98b8-4f3f-8bef-433ebef5550b with status ACTIVE [ 914.620197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.620197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.620197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.620540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.620540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.620673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.620898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.620898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.621027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.621078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.621235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.621327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.621379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.621519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.621589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.622081] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbf669bd-98b8-4f3f-8bef-433ebef5550b is going to be updated. [ 914.657012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.660032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.660032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.660032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.660032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.660032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf669bd-98b8-4f3f-8bef-433ebef5550b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.709416] env[65353]: INFO networking_nsxv3.common.synchronization [req-1f22b3e7-2d5a-448d-bfba-5959b7d78af8 req-e782c642-bf62-4025-8774-f57b3f95b872 tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 914.710909] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 914.710909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.710909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.710909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.710909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.710909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.710909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.711370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.712849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.712990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.713142] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.125126] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.223666] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.223666] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.223666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.223666] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 915.253611] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.253715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.253715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.254493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.254493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.268462] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 915.629693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.629693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.629693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.629693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.629693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.629693] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 069ced97-9b0a-489d-acf5-0da342604329 is going to be created. [ 915.637224] env[65353]: INFO networking_nsxv3.common.synchronization [None req-13a9ea00-ff46-496b-b131-727b845fbaf3 None None] Enqueued Resource ID: fe7a33ab-c027-438e-9daa-36ba82c2dc53 with Priority: HIGHEST for action port [ 915.637224] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7a33ab-c027-438e-9daa-36ba82c2dc53 with Priority: HIGHEST for action port [ 915.637224] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe7a33ab-c027-438e-9daa-36ba82c2dc53 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.637821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe7a33ab-c027-438e-9daa-36ba82c2dc53" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.638024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe7a33ab-c027-438e-9daa-36ba82c2dc53" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.639126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe7a33ab-c027-438e-9daa-36ba82c2dc53" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.639465] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7a33ab-c027-438e-9daa-36ba82c2dc53',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.659542] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.659892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.660067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.660369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.661891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.675791] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: UNINITIALIZED for 2s [ 916.146706] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe7a33ab-c027-438e-9daa-36ba82c2dc53 [ 916.146706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.146706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.146706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.146706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.146706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.146706] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe7a33ab-c027-438e-9daa-36ba82c2dc53 already deleted. [ 916.146706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe7a33ab-c027-438e-9daa-36ba82c2dc53" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.347051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 916.347559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.172362] env[65353]: INFO networking_nsxv3.common.synchronization [req-34ad0e2c-0046-430f-bf2c-3939716fabbc req-ecdf7637-b03f-4847-91e2-c4d36dec302a tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 917.172982] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 917.173389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.173530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.173610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.173909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.174178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.174421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.174488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.174658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.174758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.174856] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.281100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 917.281962] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e deletion is rescheduled due to dependency. [ 917.282104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.680041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.680041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.680041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.680041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be updated. [ 917.690700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: SUCCESS [ 917.691085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.691346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.691540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.691771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.691916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.692000] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.692282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.692395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.692487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.692617] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.712920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.713164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.714085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.714300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.715315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.726434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: IN_PROGRESS for 2s [ 918.195118] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.219024] env[65353]: INFO networking_nsxv3.common.synchronization [req-9a9d6a91-fa7e-470f-bba9-9d52c3cff15e req-b5620910-75f0-4258-b46f-eb9fe29a78f6 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 918.219024] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 918.219024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.219024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.219024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.219024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.219024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.219024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.219425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.219494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.219605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.219730] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.259845] env[65353]: INFO networking_nsxv3.common.synchronization [None req-9514d239-7b12-4515-8323-e18fd7a37b9d None None] Enqueued Resource ID: 13c75c37-9b99-45f5-be05-1755785fbc8d with Priority: HIGHEST for action port [ 918.260407] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c75c37-9b99-45f5-be05-1755785fbc8d with Priority: HIGHEST for action port [ 918.261616] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-13c75c37-9b99-45f5-be05-1755785fbc8d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.261768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13c75c37-9b99-45f5-be05-1755785fbc8d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.261837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13c75c37-9b99-45f5-be05-1755785fbc8d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.262166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13c75c37-9b99-45f5-be05-1755785fbc8d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.262267] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13c75c37-9b99-45f5-be05-1755785fbc8d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.698728] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 069ced97-9b0a-489d-acf5-0da342604329: rpc.has_security_group_logging(os_id): False [ 918.722893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.723132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.723248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.723563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.723702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.724072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.724235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.724420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.724655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.725545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.725545] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 918.727297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.727433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.727541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.727770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.727930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.728235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.728371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.728436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.728657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.728836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.728982] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 069ced97-9b0a-489d-acf5-0da342604329 is going to be created. [ 918.765367] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13c75c37-9b99-45f5-be05-1755785fbc8d [ 918.765646] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.765806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.765960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.766881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.766881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.766881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13c75c37-9b99-45f5-be05-1755785fbc8d already deleted. [ 918.766881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13c75c37-9b99-45f5-be05-1755785fbc8d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.768230] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.768481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.768658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.769270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.769270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.801912] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 918.825123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.825483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.825483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.825874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.826137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.838984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: IN_PROGRESS for 2s [ 919.019477] env[65353]: INFO networking_nsxv3.common.synchronization [req-b14b91cb-0932-4d4f-8a0e-76f61b7b8916 req-a12beed7-dbba-4fea-a155-21a096ff8ce7 tempest-ServerRescueTestJSON-1182933684 tempest-ServerRescueTestJSON-1182933684-project-member] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 919.020798] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 919.020798] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.020798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.020798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.021549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.021806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.021997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.022123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.022337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.023074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.023074] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.101557] env[65353]: INFO networking_nsxv3.common.synchronization [req-d8e80418-c6fa-4ab8-86c4-280a7e5ce522 req-9cde18c9-7a66-4748-aec4-c8e208c84c65 tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 919.102207] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 919.102865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.103797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.103869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.104534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.104768] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.104870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.104911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.105145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.105240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.105341] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.467814] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.467814] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.467814] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.468245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.468305] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.468495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.468612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.468862] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.469084] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.469333] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.469451] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.469560] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.469665] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.469792] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.469877] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.470017] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.492938] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.493204] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.493900] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.493900] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.494080] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.494283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.494451] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.494893] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.495212] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.526910] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.526910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.526910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.526910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.526910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.527458] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.527458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.527458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.527588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.527689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.527751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad already deleted. [ 919.527831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.608954] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.739971] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 919.739971] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 deletion is rescheduled due to dependency. [ 919.739971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.998697] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.999018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.999159] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.999649] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.999846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.000022] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf not found, creating... [ 920.000339] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.000537] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.000658] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.001315] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.001498] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.001904] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.002073] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.002197] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.002784] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.002784] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.002784] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf is going to be created. [ 920.026621] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.026911] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.027074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.027361] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.027621] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.027887] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.113803] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.617478] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.617478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.617478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.617945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.618273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.618769] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 920.651067] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.651067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.651067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.651067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.651067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.659330] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 920.750646] env[65353]: INFO networking_nsxv3.common.synchronization [req-b14b91cb-0932-4d4f-8a0e-76f61b7b8916 req-1bc44f8e-e809-462d-b953-758d4dc89d84 service nova] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_rules [ 920.750938] env[65353]: INFO networking_nsxv3.common.synchronization [req-b14b91cb-0932-4d4f-8a0e-76f61b7b8916 req-1bc44f8e-e809-462d-b953-758d4dc89d84 service nova] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 920.751840] env[65353]: INFO networking_nsxv3.common.synchronization [req-b14b91cb-0932-4d4f-8a0e-76f61b7b8916 req-1bc44f8e-e809-462d-b953-758d4dc89d84 service nova] Enqueued Resource ID: 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf with Priority: HIGHEST for action port [ 920.752410] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_rules [ 920.753078] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 920.753229] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf with Priority: HIGHEST for action port [ 920.753567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.753668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.753873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.754719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.754719] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.755403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.755512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.755580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.755771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.756012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.756104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.756104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.756264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.756354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.756450] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.758227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.758227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.758227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.758227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.758227] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.815465] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 920.815465] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 920.815465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.853282] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: SUCCESS [ 920.853282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.259373] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.260915] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.260915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.260915] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf with status ACTIVE [ 921.261169] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.261169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.261169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.261355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.261444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.261610] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.261714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.261772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.261920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.262088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.262288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.262386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.262435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.263280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.263280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.263280] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf is going to be updated. [ 921.294216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.294365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.294418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.294645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.294762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.294950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c13fbdc-5f0f-4676-a09d-7e8af8b7dfbf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.766671] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.269710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.269868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.269956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.270210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.270313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.270412] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be created. [ 922.298641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.298798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.298872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.299999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.299999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.309710] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: UNINITIALIZED for 2s [ 922.673371] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 922.673371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.819942] env[65353]: INFO networking_nsxv3.common.synchronization [req-78dd6cd6-b86f-4051-a479-fe2d254eb6d8 req-915253f3-66fa-4529-b1e7-f69b5aa31d0a tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 922.821259] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 922.822142] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.822789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.823051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.823489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.823489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.823604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.824104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.824104] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.227491] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.227679] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.227798] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.228141] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.228398] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.228582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.228705] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.228873] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.229017] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.229231] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.229343] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.229449] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.229555] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.229659] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.229763] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.229895] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.249468] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.249624] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.249763] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.249944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.250316] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-7a603242-3fe4-4101-9ad3-6da0af5d304e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.250587] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.250715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.251148] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.251301] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a603242-3fe4-4101-9ad3-6da0af5d304e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.327092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.327284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.327355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.328057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.328161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.328367] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.328469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.328546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.328753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.328836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.328923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 already deleted. [ 923.329011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.754155] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.754397] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.754526] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.754829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.755021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.755229] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 7a603242-3fe4-4101-9ad3-6da0af5d304e not found, creating... [ 923.755608] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.755787] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.755973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.756274] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.756460] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.757023] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.757152] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.757199] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.757415] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.757560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.757712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 7a603242-3fe4-4101-9ad3-6da0af5d304e is going to be created. [ 923.779991] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.780313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.780438] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.780790] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.781063] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.781388] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.321313] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 924.321618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.321778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.322081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.322340] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.322340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.322481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.322608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.322608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.322732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.322775] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [req-78dd6cd6-b86f-4051-a479-fe2d254eb6d8 req-30f3fb6e-67d5-46ea-9547-d700f3ad5c5a service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [req-78dd6cd6-b86f-4051-a479-fe2d254eb6d8 req-30f3fb6e-67d5-46ea-9547-d700f3ad5c5a service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [req-78dd6cd6-b86f-4051-a479-fe2d254eb6d8 req-30f3fb6e-67d5-46ea-9547-d700f3ad5c5a service nova] Enqueued Resource ID: 7a603242-3fe4-4101-9ad3-6da0af5d304e with Priority: HIGHEST for action port [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 924.512430] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a603242-3fe4-4101-9ad3-6da0af5d304e with Priority: HIGHEST for action port [ 924.512775] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.512895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.512958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.513225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.513304] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.514210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.514310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.514372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.514537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.514675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.514801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.514832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.515117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.515216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.515312] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.516461] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a603242-3fe4-4101-9ad3-6da0af5d304e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.516620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.516685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.516838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.516911] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a603242-3fe4-4101-9ad3-6da0af5d304e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.824959] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.825205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.825205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.825435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.825603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.825700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.825762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.825918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.826037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.826176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.826374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.826497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.826547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.826665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.826885] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.826999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.827086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.827230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.827308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.827408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.827486] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.021399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.021550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.021890] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.022888] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a603242-3fe4-4101-9ad3-6da0af5d304e with status ACTIVE [ 925.023106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.023382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.023382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.023485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.023573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.023861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.024047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.024127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.024248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.024326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.024516] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.024609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.024669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.024826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.024881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.024969] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a603242-3fe4-4101-9ad3-6da0af5d304e is going to be updated. [ 925.049363] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.049538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.049597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.049811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.049953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.050262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a603242-3fe4-4101-9ad3-6da0af5d304e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.329371] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad: rpc.has_security_group_logging(os_id): False [ 925.351399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.351639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.351695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.351964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.352120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.352413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.353022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.353022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.353146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.353322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.353462] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.353603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.353705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.354296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.354408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.354600] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.354693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.354815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.354900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.354985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.355086] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be created. [ 925.417330] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.417598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.417598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.418238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.418433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.434415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 925.528325] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.035287] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.035579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.035579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.035723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.035773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.035864] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be created. [ 926.067066] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.067229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.067415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.067509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.067664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.079087] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: UNINITIALIZED for 2s [ 926.167346] env[65353]: INFO networking_nsxv3.common.synchronization [req-8013b79c-8f69-466e-b905-ca33a84082fc req-1e50b1ea-944f-4b6b-87f9-f96ee1a2f9b3 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 926.167912] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 926.170256] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.170402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.170454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.170743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.170832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.170942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.171014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.171265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.171314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.171410] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.673524] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.175665] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.448292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 927.448525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.678939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.679270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.679270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.679477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.679587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.679728] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 927.710545] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.711752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.711752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.711752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.711752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.722588] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 928.093244] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 928.093441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.093616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.093881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.094100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.094225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.094292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.094858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.094979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.095108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.095184] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.600769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.601056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.601056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.601359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.601573] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.601953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.601953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.601953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.602168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.602168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.602277] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.602344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.602385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.603047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.603047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.603365] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.034368] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca847035-6b03-49ea-88c6-7a40102af748 req-c57b169d-be80-4cf3-a79f-a869c2491230 tempest-MigrationsAdminTest-113975804 tempest-MigrationsAdminTest-113975804-project-member] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 929.034368] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGHEST for action security_group_members [ 929.034368] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.034368] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.034368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.034368] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.106919] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 929.127752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.128023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.128128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.128419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.128576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.128983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.130357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.130357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.130357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.136720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.136720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.136720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.136720] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be created. [ 929.213533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.215039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.215135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.215438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.215704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.235612] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 929.539033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.539033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.539033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.539033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.564886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.565317] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.565483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.569035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.569035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.569035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.569035] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be updated. [ 929.615660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.616072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.616122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.616537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.616606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.629266] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: IN_PROGRESS for 2s [ 929.733766] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 929.733766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.948296] env[65353]: INFO networking_nsxv3.common.synchronization [None req-80c10eff-c7d0-42d7-b9db-ea92dd32989d tempest-ServersTestBootFromVolume-150012720 tempest-ServersTestBootFromVolume-150012720-project-member] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 930.949064] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 930.949432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.949590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.949739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.949953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.950050] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.966137] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4e94ec1d-ff48-41f3-93a9-f615b39b05f2 None None] Enqueued Resource ID: 4367c169-699b-41c5-8d73-ce00c7480e1e with Priority: HIGHEST for action port [ 930.969940] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4367c169-699b-41c5-8d73-ce00c7480e1e with Priority: HIGHEST for action port [ 930.969940] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4367c169-699b-41c5-8d73-ce00c7480e1e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.969940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4367c169-699b-41c5-8d73-ce00c7480e1e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.969940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4367c169-699b-41c5-8d73-ce00c7480e1e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.969940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4367c169-699b-41c5-8d73-ce00c7480e1e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.969940] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4367c169-699b-41c5-8d73-ce00c7480e1e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.044549] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3e7e02aa-2617-4ac9-8660-83048c0b4f43 tempest-ServersTestBootFromVolume-150012720 tempest-ServersTestBootFromVolume-150012720-project-member] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 931.045100] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 931.045418] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.045517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.249694] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 931.249921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.473407] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.473765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.474389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.474389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.474389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.474389] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 already deleted. [ 931.474618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.474804] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4367c169-699b-41c5-8d73-ce00c7480e1e [ 931.474937] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.475076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.475156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.475294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.475480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.475567] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4367c169-699b-41c5-8d73-ce00c7480e1e already deleted. [ 931.475649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4367c169-699b-41c5-8d73-ce00c7480e1e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.475779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.475924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.476030] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.643300] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77899b4e-41ba-45bf-ac89-22e780314f5f in Status: SUCCESS [ 931.643921] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f deletion is rescheduled due to dependency. [ 931.643921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.001845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.002216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.002216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.002448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.002551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.002653] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 already deleted. [ 932.002762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.888018] env[65353]: INFO networking_nsxv3.common.synchronization [req-f480caed-a5fa-4f1f-abe7-3647839cc8f4 req-175e1cde-66f7-45a1-8970-834c5977785b tempest-ServerPasswordTestJSON-1808138460 tempest-ServerPasswordTestJSON-1808138460-project-member] Enqueued Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 932.888516] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 932.889435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.889435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.889435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.889948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.890155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.890259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.890329] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.890490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.890578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.890663] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.363684] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.364063] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-146" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.364063] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-146" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.364398] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-146" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.365023] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.365023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.365023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.365201] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.365233] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.365430] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.365642] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.365642] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.365730] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.365918] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.366031] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.366770] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.385905] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.386158] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 933.386353] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.386637] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-146" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.386971] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.387166] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.387288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.387612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.387749] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.392460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.393500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.393609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.393830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.393995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.395613] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.395750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.395808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.395991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.396100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.396196] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c already deleted. [ 933.396266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.851348] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3150318e-8160-4de4-8ace-ae8588c675f8 None None] Enqueued Resource ID: 1a009327-7185-4760-8d52-9998b770e612 with Priority: HIGHEST for action port [ 933.851938] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a009327-7185-4760-8d52-9998b770e612 with Priority: HIGHEST for action port [ 933.852293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a009327-7185-4760-8d52-9998b770e612 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.852456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a009327-7185-4760-8d52-9998b770e612" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.852495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a009327-7185-4760-8d52-9998b770e612" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.852817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a009327-7185-4760-8d52-9998b770e612" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.853182] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a009327-7185-4760-8d52-9998b770e612',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.890569] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.892698] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 not found, creating... [ 933.892698] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.892698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.893178] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.893178] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.893339] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.893583] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.893700] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.893986] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.894785] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.894965] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 is going to be created. [ 933.919514] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.920463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.920463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.920463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.920463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.920696] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.358970] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a009327-7185-4760-8d52-9998b770e612 [ 934.358970] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.358970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.358970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.363249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.363249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.363249] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a009327-7185-4760-8d52-9998b770e612 already deleted. [ 934.363249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a009327-7185-4760-8d52-9998b770e612" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.736801] env[65353]: INFO networking_nsxv3.common.synchronization [req-f480caed-a5fa-4f1f-abe7-3647839cc8f4 req-6c225dbc-0203-4a3f-b924-7ddff9537535 service nova] Enqueued Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_rules [ 934.736957] env[65353]: INFO networking_nsxv3.common.synchronization [req-f480caed-a5fa-4f1f-abe7-3647839cc8f4 req-6c225dbc-0203-4a3f-b924-7ddff9537535 service nova] Enqueued Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 934.737099] env[65353]: INFO networking_nsxv3.common.synchronization [req-f480caed-a5fa-4f1f-abe7-3647839cc8f4 req-6c225dbc-0203-4a3f-b924-7ddff9537535 service nova] Enqueued Resource ID: 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 with Priority: HIGHEST for action port [ 934.737840] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_rules [ 934.737840] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 934.737988] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 with Priority: HIGHEST for action port [ 934.742489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.742634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.742795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.742988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.743091] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.744124] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.744243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.744606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.744606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.744841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.744841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.744841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.745044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.745044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.745141] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.751084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.751267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.751330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.751522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.751594] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.960520] env[65353]: INFO networking_nsxv3.common.synchronization [None req-612ac9bd-8ff5-4b1c-be81-495cacd31a8f tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 934.960520] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 934.960907] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.960907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.960907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.961099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.961179] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.084046] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c86e6f46-4218-450b-b58f-adfcaca65278 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 935.085456] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 935.085819] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.085999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.253626] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.253812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.254329] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.255127] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 with status ACTIVE [ 935.255422] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.255588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.255588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.256743] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.256743] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.256743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.257173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.257393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.257476] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5 is going to be updated. [ 935.284116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.284319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.284574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.285234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.285234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.285234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eb2ac38-06e1-45f4-b2ee-1b1224de0fb5" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.485783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.485783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.485783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.485783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.486314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.486314] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 already deleted. [ 935.486314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.487522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.487522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.487522] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.760451] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.015916] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.016166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.016274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.016614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.016788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.016955] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 already deleted. [ 936.017096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.265757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.265757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.265757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.265987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.266099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.267619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c is going to be created. [ 936.291610] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.291610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.291610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.291610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.291610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.302039] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: UNINITIALIZED for 2s [ 936.482886] env[65353]: INFO networking_nsxv3.common.synchronization [req-a5e11447-3ad4-4581-9292-190c088dd31b req-a21c8b23-865f-4cd2-a981-53e705d75fee tempest-ServersAdminTestJSON-1078185034 tempest-ServersAdminTestJSON-1078185034-project-member] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 936.483414] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGHEST for action security_group_members [ 936.484170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.484170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.484170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.484948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.485734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.485734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.485734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.485734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.485734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.486890] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.989164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.989348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.989414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.989651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.013112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.013403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.013525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.013592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.013784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.013867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.014057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be updated. [ 937.044160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.044313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.044427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.044574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.044707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.056945] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: IN_PROGRESS for 2s [ 937.278432] env[65353]: INFO networking_nsxv3.common.synchronization [req-aacfa645-88eb-40ee-b987-e608e8cf4530 req-cd3f88fb-894f-4e4d-929c-1bd164d2d7af tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 937.278432] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 937.278432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.278432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.278432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.278432] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.782954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.782954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.782954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.782954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.782954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.783978] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.783978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.783978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.783978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.783978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.785028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 937.817832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.818336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.818336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.818336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.818469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.835292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 938.312659] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: SUCCESS [ 938.312659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.312659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.312842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.313040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.313151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.313408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.313408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.313505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.313533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.313599] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.816308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.816606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.816606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.816754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.816922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.817037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.817102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.817258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.817341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.817428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.819174] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.819620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.819701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.819874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.820038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.820144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.820206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.820346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.820425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.820511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.820601] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.068317] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2f635c3-4601-4155-b8e5-e2dab677e518 in Status: SUCCESS [ 939.068317] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 deletion is rescheduled due to dependency. [ 939.068317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.288602] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d54aa0f-42ff-416a-ac89-e163e95c0ad3 req-90762047-e1cc-4ced-a101-f6acc2f41d40 tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 939.289302] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 939.289636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.289840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.289840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.290976] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.324303] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b5a0023-7c40-4513-bccf-974952e7a64c: rpc.has_security_group_logging(os_id): False [ 939.349649] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.349840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.349840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.350109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.350202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.350446] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.350571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.350650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.350866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.350943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.351178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.351287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.351369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.351517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.351605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.351825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.351974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.352047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.352196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.352285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.352373] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c is going to be created. [ 939.424810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.425034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.425166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.425752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.425752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.453273] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: IN_PROGRESS for 2s [ 939.678115] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.678377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.678446] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.678794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.680486] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.680741] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.680927] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.681345] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.681432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.681908] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.681908] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.682102] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.682227] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.682288] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.682392] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.682531] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.710554] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.712507] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.712507] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.712507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-924" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.712507] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f9665aef-8267-4ce6-9d5d-b49e17ea1346 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.712507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.712507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.712507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.712507] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9665aef-8267-4ce6-9d5d-b49e17ea1346',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.794136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.794298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.794369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.794666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.794954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.795295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.795658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.795658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.795658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.795830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.795830] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 939.839367] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.839367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.839367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.839367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.839367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.851279] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 939.852381] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 939.852699] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 939.852699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.217951] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.217951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.217951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.219109] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.219109] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.219109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f9665aef-8267-4ce6-9d5d-b49e17ea1346 not found, creating... [ 940.219320] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.219542] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.219683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.219956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.221013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.221013] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.221013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.221013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.221249] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.221425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.221587] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f9665aef-8267-4ce6-9d5d-b49e17ea1346 is going to be created. [ 940.243441] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.243978] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.244257] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.244694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.245099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.245435] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.078470] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d54aa0f-42ff-416a-ac89-e163e95c0ad3 req-6e36ef60-a548-4b0b-ad61-f799f904b346 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 941.078745] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d54aa0f-42ff-416a-ac89-e163e95c0ad3 req-6e36ef60-a548-4b0b-ad61-f799f904b346 service nova] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 941.078823] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d54aa0f-42ff-416a-ac89-e163e95c0ad3 req-6e36ef60-a548-4b0b-ad61-f799f904b346 service nova] Enqueued Resource ID: f9665aef-8267-4ce6-9d5d-b49e17ea1346 with Priority: HIGHEST for action port [ 941.079567] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_rules [ 941.079567] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 941.079687] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9665aef-8267-4ce6-9d5d-b49e17ea1346 with Priority: HIGHEST for action port [ 941.079891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.080063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.080291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.080336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.080731] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.084019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.084019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.084019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9665aef-8267-4ce6-9d5d-b49e17ea1346 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.084019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.084019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.084843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.084843] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9665aef-8267-4ce6-9d5d-b49e17ea1346',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.467538] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: SUCCESS [ 941.467779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.587348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.587348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.587348] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9665aef-8267-4ce6-9d5d-b49e17ea1346 with status ACTIVE [ 941.587348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.587348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.587573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.588166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.588970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.588970] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.588970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.588970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.588970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.588970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.589177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.589292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.589528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.589613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.589684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.589786] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9665aef-8267-4ce6-9d5d-b49e17ea1346 is going to be updated. [ 941.611757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.611932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.612037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.612371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.612525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.612686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9665aef-8267-4ce6-9d5d-b49e17ea1346" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.868386] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 941.868386] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e deletion is rescheduled due to dependency. [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.870143] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.870143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.870143] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.977138] env[65353]: INFO networking_nsxv3.common.synchronization [req-3d2e5b7f-9c29-47bd-822e-59def2c99b63 req-64cadf9e-34f1-4f1e-ac28-de10a1b513ef tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 941.977138] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 941.977138] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.977138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.977138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.977138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.978135] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.978384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.978536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.978891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.979074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.979422] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.334610] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.334935] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.334935] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.335238] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.335501] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.335658] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.335773] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.335987] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.340176] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.340419] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.340537] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.340648] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.340752] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.340865] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.340964] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.341110] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.361435] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.361617] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.361754] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.361976] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.362314] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-ab95faea-9ec8-4398-98d0-874502d37b18 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.362485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.362602] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.362914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.363077] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab95faea-9ec8-4398-98d0-874502d37b18',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.373312] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.486531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.486531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.486531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.486531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.486531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.486857] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.486857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.486857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.486982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.487069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.487173] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 942.518973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.519166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.519240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.519489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.519638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.531461] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 942.867240] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.867565] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.868198] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.868547] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.868713] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.868874] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port ab95faea-9ec8-4398-98d0-874502d37b18 not found, creating... [ 942.869179] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.869363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.869610] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.869708] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.869878] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.873438] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.873654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.873772] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.874076] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.874259] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.874472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: ab95faea-9ec8-4398-98d0-874502d37b18 is going to be created. [ 942.875671] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.924075] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.924075] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.924262] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.924535] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.924797] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.925029] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.378640] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.379093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.379093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.379093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.380154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.380154] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 943.413883] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.414164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.414307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.414628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.414880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.429585] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 943.637567] env[65353]: INFO networking_nsxv3.common.synchronization [req-3d2e5b7f-9c29-47bd-822e-59def2c99b63 req-34b4a1b0-6b0e-4345-94d0-f8bed0836d2c service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 943.637908] env[65353]: INFO networking_nsxv3.common.synchronization [req-3d2e5b7f-9c29-47bd-822e-59def2c99b63 req-34b4a1b0-6b0e-4345-94d0-f8bed0836d2c service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 943.638276] env[65353]: INFO networking_nsxv3.common.synchronization [req-3d2e5b7f-9c29-47bd-822e-59def2c99b63 req-34b4a1b0-6b0e-4345-94d0-f8bed0836d2c service nova] Enqueued Resource ID: ab95faea-9ec8-4398-98d0-874502d37b18 with Priority: HIGHEST for action port [ 943.639036] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 943.639267] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 943.639460] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab95faea-9ec8-4398-98d0-874502d37b18 with Priority: HIGHEST for action port [ 943.639927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.640818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.640818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.640896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641440] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.644339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.644339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.644339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab95faea-9ec8-4398-98d0-874502d37b18 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.644339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.644339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.644339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.644339] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab95faea-9ec8-4398-98d0-874502d37b18',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.145349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.145484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.147758] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab95faea-9ec8-4398-98d0-874502d37b18 with status ACTIVE [ 944.147758] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.147758] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.147758] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.147758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.147758] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab95faea-9ec8-4398-98d0-874502d37b18 is going to be updated. [ 944.173794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.173794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab95faea-9ec8-4398-98d0-874502d37b18" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.438041] env[65353]: INFO networking_nsxv3.common.synchronization [req-b164bbf7-4e08-4e9c-8a64-b1a5140d816b req-4795a6a8-4f19-4598-86e6-acfac771e239 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 944.438654] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 944.438654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.438654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.438654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.438879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.439977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.440188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.440260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.440451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.440540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.440636] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.543293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 944.544072] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 944.544072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.544072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.544700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.544770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.545091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.545164] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.902193] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.902391] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.902454] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.902867] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.903260] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.903575] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.903803] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.904245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.904533] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.905226] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.905484] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.905591] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.905822] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.906130] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.906283] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.906577] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.933189] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.933652] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.934104] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.934333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-196" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.935044] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f797db31-365a-4662-ae19-72ab374dfc21 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.935352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.935550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.935927] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.936169] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f797db31-365a-4662-ae19-72ab374dfc21',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.946060] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.946873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.946873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.946873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.947088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.947167] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.947312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.947409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.947672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.947753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.947845] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 944.985973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.985973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.985973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.985973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.985973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.995889] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 945.049241] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.441088] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 945.441444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.441886] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.442102] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.442372] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.442835] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.442916] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.443154] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f797db31-365a-4662-ae19-72ab374dfc21 not found, creating... [ 945.443455] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.443653] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.443786] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.444077] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.444210] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.444507] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.444706] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.444855] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.445000] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.445165] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.445331] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f797db31-365a-4662-ae19-72ab374dfc21 is going to be created. [ 945.446437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.446597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.446756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.446924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.446924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.447062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.447137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.447221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.447312] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.477241] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.477241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.477241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.477503] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.477661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.477904] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.550885] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.950111] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.950591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.950800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.951301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.952463] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.952463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.952463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.952463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.952463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.952463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.952752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.952752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.952937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.953087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.953254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.953347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.953406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.953550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.953802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.953961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.954508] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.056275] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.056275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.056275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.056275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.056275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.056275] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 946.092688] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.092922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.092922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.093201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.093264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.105046] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 946.263165] env[65353]: INFO networking_nsxv3.common.synchronization [req-b164bbf7-4e08-4e9c-8a64-b1a5140d816b req-3fab15ad-33ae-4028-9dd7-4d0ed2289232 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 946.263351] env[65353]: INFO networking_nsxv3.common.synchronization [req-b164bbf7-4e08-4e9c-8a64-b1a5140d816b req-3fab15ad-33ae-4028-9dd7-4d0ed2289232 service nova] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 946.263490] env[65353]: INFO networking_nsxv3.common.synchronization [req-b164bbf7-4e08-4e9c-8a64-b1a5140d816b req-3fab15ad-33ae-4028-9dd7-4d0ed2289232 service nova] Enqueued Resource ID: f797db31-365a-4662-ae19-72ab374dfc21 with Priority: HIGHEST for action port [ 946.267023] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_rules [ 946.267023] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 946.267023] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f797db31-365a-4662-ae19-72ab374dfc21 with Priority: HIGHEST for action port [ 946.267023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.267023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.267023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.267023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.267023] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.267023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.267023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.267559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f797db31-365a-4662-ae19-72ab374dfc21 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.267679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.267719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.267875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.267985] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f797db31-365a-4662-ae19-72ab374dfc21',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.458411] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e: rpc.has_security_group_logging(os_id): False [ 946.476610] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.476721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.476721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.477072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.477183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.477430] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.477569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.477616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.477821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.477958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.478282] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.478399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.478455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.478594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.478799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.478863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.478916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.479054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.479322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.479403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.480030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 946.549339] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.549477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.549547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.549771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.549916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.564258] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 946.772134] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.773541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.775262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f797db31-365a-4662-ae19-72ab374dfc21 with status ACTIVE [ 946.775535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.775814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.775937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.776301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.776507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.776784] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.777699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.777699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.777699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.777699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.777833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.778205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.779283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.779283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.779283] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f797db31-365a-4662-ae19-72ab374dfc21 is going to be updated. [ 946.823298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.823298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.823298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.823298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.823615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.823733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f797db31-365a-4662-ae19-72ab374dfc21" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 947.018030] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018030] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.521401] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.024724] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.116704] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 948.116968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.119554] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119554] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.529705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.530113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.530113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.530191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.530223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.530321] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 948.566046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.566215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.566215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.566559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.566559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.581024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 948.594680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 948.595616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.620818] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.621106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.621212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.621596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.622180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.622180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.622180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.622610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.622610] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622984] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.623123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.623190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.623399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.623700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.623814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.623876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.624673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.624673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.624673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.624673] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.127600] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 949.151488] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.151757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.151757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.152040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.152199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.152519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.152672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.152764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.153008] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.153133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.153413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.153576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.153669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.153879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.154056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.154346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.154486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.154579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.154781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.154922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.155057] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 949.223257] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.223514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.223514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.223660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.223820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.241696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 949.358480] env[65353]: INFO networking_nsxv3.common.synchronization [req-6285f595-25f9-4c8e-aa25-97201ad09cdf req-0a538262-84bf-42bf-b588-c3cac657e55c tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 949.360293] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 949.360779] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.361010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.361085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.361456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.361694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.362541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.362541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.362541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.362541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.362541] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.865172] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.865532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.865667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.865865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.866009] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.866324] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.866435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.866519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.866705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.866799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.866921] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 already deleted. [ 949.866972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.941895] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.942173] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.942239] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.942502] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.943092] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.943092] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.943334] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.943403] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.943528] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.943793] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.943868] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.943963] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.944110] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.944222] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.944327] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.944453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.966140] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.966426] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.966502] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.966684] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.967035] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-cf974871-3b5c-4574-9f2c-329617306d86 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.967245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.967381] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.967724] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.967867] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf974871-3b5c-4574-9f2c-329617306d86',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.473026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.473026] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port cf974871-3b5c-4574-9f2c-329617306d86 not found, creating... [ 950.473026] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.473026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.474267] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.474833] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.475318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.475795] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.476157] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.476612] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: cf974871-3b5c-4574-9f2c-329617306d86 is going to be created. [ 950.499040] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.499699] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.500158] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.500633] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.501089] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.501441] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.595025] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 950.597670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.597670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.597670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.597670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.601418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.601418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.601418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.601418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.601418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.601418] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.105017] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.105480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.105480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.107498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.107498] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.107498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.107498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.107498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.108016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.108129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.108324] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.108429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.108473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.108632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.108782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.108871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.108927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.109081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.109158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.109234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.109319] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.249235] env[65353]: INFO networking_nsxv3.common.synchronization [req-55e9437d-ee7d-4f2d-982e-92fd013cdc03 req-e3ec395c-493a-43c6-a3e3-394f5bc7230b tempest-ServerPasswordTestJSON-1808138460 tempest-ServerPasswordTestJSON-1808138460-project-member] Enqueued Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 951.249756] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGHEST for action security_group_members [ 951.250292] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.250450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.250595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.250682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.251140] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.251140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.251140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.251140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.251376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.251376] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.257170] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 951.257425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.285348] env[65353]: INFO networking_nsxv3.common.synchronization [req-6285f595-25f9-4c8e-aa25-97201ad09cdf req-344482f9-e933-4c47-b12b-1fc4add86939 service nova] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 951.286173] env[65353]: INFO networking_nsxv3.common.synchronization [req-6285f595-25f9-4c8e-aa25-97201ad09cdf req-344482f9-e933-4c47-b12b-1fc4add86939 service nova] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 951.286173] env[65353]: INFO networking_nsxv3.common.synchronization [req-6285f595-25f9-4c8e-aa25-97201ad09cdf req-344482f9-e933-4c47-b12b-1fc4add86939 service nova] Enqueued Resource ID: cf974871-3b5c-4574-9f2c-329617306d86 with Priority: HIGHEST for action port [ 951.286173] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_rules [ 951.286317] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 951.286431] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf974871-3b5c-4574-9f2c-329617306d86 with Priority: HIGHEST for action port [ 951.286970] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.286970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.286970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.287153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.287153] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.288580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.288706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.288774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.289248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.289248] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.289248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.289528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.289528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.289528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.289634] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.291187] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf974871-3b5c-4574-9f2c-329617306d86 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.291187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.291187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.291187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.291187] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf974871-3b5c-4574-9f2c-329617306d86',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.614851] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef90e1f-f512-4c74-82f2-c918b64f5aee: rpc.has_security_group_logging(os_id): False [ 951.640131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.640131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.640131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.640770] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.640770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.640770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.640770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.640770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.640770] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.641156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.641156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.642960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.642960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.642960] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 951.711983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.712205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.712296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.712514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.712662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.728308] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 951.754191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.754378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.754444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.754681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.754775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.758020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.758020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.758020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.758020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.758020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.758020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c is going to be updated. [ 951.790425] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.790425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.794163] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.795778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf974871-3b5c-4574-9f2c-329617306d86 with status ACTIVE [ 951.795864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.795991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.796077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.796419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.796508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.796712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.797096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.797214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.797433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.797932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.797932] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.798073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.798164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.798286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.798508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.798580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf974871-3b5c-4574-9f2c-329617306d86 is going to be updated. [ 951.800759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.801652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.801652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.801652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.801652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.816115] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: IN_PROGRESS for 2s [ 951.825095] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.825596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.825596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.825596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.825734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.826148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf974871-3b5c-4574-9f2c-329617306d86" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.300944] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.803977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.804251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.804344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.804587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.804706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.804784] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 is going to be created. [ 952.848703] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.848703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.848703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.848703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.848703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.867547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: UNINITIALIZED for 2s [ 953.745761] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 953.746169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.827937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b5a0023-7c40-4513-bccf-974952e7a64c in Status: SUCCESS [ 953.828379] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c deletion is rescheduled due to dependency. [ 953.828379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.876699] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: SUCCESS [ 954.877035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.877141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.877394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.877602] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.877736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.877931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.877971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.878059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.879390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.879390] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.923216] env[65353]: INFO networking_nsxv3.common.synchronization [req-efd9b3f4-fc25-4534-a455-995c2d61c2a2 req-57757246-f7c2-4a6e-86ee-3e2171dc4e1e tempest-ServersWithSpecificFlavorTestJSON-1512383703 tempest-ServersWithSpecificFlavorTestJSON-1512383703-project-member] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 954.923946] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGHEST for action security_group_members [ 954.924357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.924490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.924557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.924768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.924926] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.925074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.925187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.925357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.925453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.925657] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.981015] env[65353]: INFO networking_nsxv3.common.synchronization [req-3f695190-4359-41b9-a080-ccc2267e8dd1 req-fadc503b-7cb6-43ee-8ad2-a88d0e1fd54c tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 954.981689] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 954.983381] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.983551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.983645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.983936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.984166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.984311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.984396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.984621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.984705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.984835] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.245938] env[65353]: INFO networking_nsxv3.common.synchronization [req-16e217ff-19cf-4d9b-98d5-a402656a8272 req-d9aad82f-d5f6-4561-84fd-5f1e9da28e6b tempest-ImagesOneServerNegativeTestJSON-975811263 tempest-ImagesOneServerNegativeTestJSON-975811263-project-member] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 955.247050] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGHEST for action security_group_members [ 955.247298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.247448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.247548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.247781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.248011] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.248220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.248378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.248688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.248857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.249039] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.380683] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.430663] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.430855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.430968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.431275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.431408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.431637] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.431755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.431821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.432037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.432159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.432271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be updated. [ 955.465892] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.466128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.466173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.466425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.466586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.480333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: IN_PROGRESS for 2s [ 955.487178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.487606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.487718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.488310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.488688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.489568] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.489724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.489724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.490353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.490353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.490353] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 955.533392] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.533615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.533749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.534352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.534352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.547718] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 955.751040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.751180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.751180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.751451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.751549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.751804] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.751937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.752028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.752195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.752298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.752389] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be updated. [ 955.783861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.784127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.784195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.784764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.784943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.882286] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8cbd2fb-a386-46ba-9054-c04ccc0a46d9: rpc.has_security_group_logging(os_id): False [ 955.902629] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: IN_PROGRESS for 2s [ 955.915217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.915217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.915217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.915217] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 is going to be created. [ 956.009223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.009351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.009393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.009768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.009911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.023246] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: IN_PROGRESS for 2s [ 956.306276] env[65353]: INFO networking_nsxv3.common.synchronization [req-417e95b0-ca12-4577-9385-2580f6d84332 req-51a4e2f0-9cf1-4e60-a815-406f5c98bc5c tempest-ServerRescueTestJSON-1182933684 tempest-ServerRescueTestJSON-1182933684-project-member] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 956.307664] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 956.307743] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.307836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.307884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.308243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.308399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.308462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.308777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.308777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.309040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.309388] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.639406] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.639685] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.639830] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.640180] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.640479] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.640683] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.641320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.641320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.641442] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.641637] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.641805] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.641929] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.642066] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.642208] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.642349] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.642517] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.665318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.665705] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.665705] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.665900] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-669" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.666419] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-b656c532-dc72-488a-85b9-07c12f97b502 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.667395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.667591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.667958] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.668183] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b656c532-dc72-488a-85b9-07c12f97b502',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.811230] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.171159] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.171459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.171600] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.171856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.172082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.172241] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port b656c532-dc72-488a-85b9-07c12f97b502 not found, creating... [ 957.172530] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.172685] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.172822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.173068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.173222] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.174521] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.174521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.174521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.174521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.174521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.174521] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: b656c532-dc72-488a-85b9-07c12f97b502 is going to be created. [ 957.196633] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.196863] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.197013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.197335] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.198200] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.198200] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.316524] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.490494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 in Status: SUCCESS [ 957.490494] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 deletion is rescheduled due to dependency. [ 957.490494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.556505] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 957.556733] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 957.556808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.820095] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.820095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.820095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.820095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.820095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.820095] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be updated. [ 957.855455] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.855604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.855670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.855891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.856056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.870943] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 957.913986] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e in Status: SUCCESS [ 957.914187] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e deletion is rescheduled due to dependency. [ 957.914308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [req-417e95b0-ca12-4577-9385-2580f6d84332 req-4809761c-aa54-4e1e-b203-f362994f19c6 service nova] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_rules [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [req-417e95b0-ca12-4577-9385-2580f6d84332 req-4809761c-aa54-4e1e-b203-f362994f19c6 service nova] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [req-417e95b0-ca12-4577-9385-2580f6d84332 req-4809761c-aa54-4e1e-b203-f362994f19c6 service nova] Enqueued Resource ID: b656c532-dc72-488a-85b9-07c12f97b502 with Priority: HIGHEST for action port [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_rules [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 957.941298] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b656c532-dc72-488a-85b9-07c12f97b502 with Priority: HIGHEST for action port [ 957.941842] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.942019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.942090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.942258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.942324] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.943677] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.943771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.944074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b656c532-dc72-488a-85b9-07c12f97b502 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.944216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.944281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.944473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.945204] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b656c532-dc72-488a-85b9-07c12f97b502',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.040067] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: SUCCESS [ 958.040619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.111291] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d9963c8-dc90-41c0-880b-a3ed41a8498f req-eb5f5edb-47ae-4e2a-b5c2-72808a9a7f16 tempest-ServersTestJSON-1545359115 tempest-ServersTestJSON-1545359115-project-member] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 958.111804] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGHEST for action security_group_members [ 958.112376] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.112511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.112564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.113132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.113132] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.113132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.113132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.113512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.113512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.113512] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.447650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.447650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.447650] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b656c532-dc72-488a-85b9-07c12f97b502 with status ACTIVE [ 958.447650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.448030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.448030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.448427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.448427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.448427] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.450104] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.450104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.450104] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b656c532-dc72-488a-85b9-07c12f97b502 is going to be updated. [ 958.477365] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.477503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.477575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.477784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.477921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.478090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b656c532-dc72-488a-85b9-07c12f97b502" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.617200] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.617200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.617318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.618228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.642016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.642295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.642424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.642489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.642720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.642817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.642911] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e is going to be updated. [ 958.676540] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.676799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.676799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.676953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.687981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: IN_PROGRESS for 2s [ 959.882944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 959.883388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.883449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.883655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.883870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.883988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.884127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.884304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.884385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.884483] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.386538] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.698651] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e in Status: SUCCESS [ 960.698747] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e deletion is rescheduled due to dependency. [ 960.698808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.888421] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.391622] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.391864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.391864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.392132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.392232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.392335] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be updated. [ 961.431398] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.431573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.431633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.431813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.431962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.443148] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 963.113161] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.113624] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 963.454838] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 963.454904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.455252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.455354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.455489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.455602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.455663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.455810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.455887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.455965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.456073] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.958150] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.958404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.958515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.958766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.958986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.959140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.959267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.959410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.959580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.959671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.959888] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.959949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.959990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.960286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.960456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.960749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.960749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.960838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.960998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.961263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.961263] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.329413] env[65353]: INFO networking_nsxv3.common.synchronization [req-5bf30681-963c-4a71-b73b-169de4fa92a1 req-cb23119f-9da4-4b9d-b3f5-a097f025b139 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 964.330153] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 964.330504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.330675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.330752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.331084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.331257] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.331405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.331482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.331689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.331799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.331926] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.464491] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad: rpc.has_security_group_logging(os_id): False [ 964.484160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.484537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.484537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.484625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.484690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.484870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.484963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.485030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.485216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.485326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.485476] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.485572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.485625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.485776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.485903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.486158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.486238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.486270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.486712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.486712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.486835] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be updated. [ 964.556136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.556283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.556357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.556576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.556718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.594177] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 964.598625] env[65353]: INFO networking_nsxv3.common.synchronization [req-46e4bd50-43d3-4a0e-8a51-65592921544b req-493e9eb4-5d9e-40a8-a884-832e711a1dba tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 964.599204] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 964.599555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.599756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.600400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.600495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.601045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.601166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.601442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.601442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.601536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.601566] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.715597] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.715841] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.715965] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.716266] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.716544] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.716896] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.717053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.717297] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.717514] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.717900] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.717981] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.718138] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.718268] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.718437] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.718683] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.718838] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.745025] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.745282] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.745421] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.745598] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.745934] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-54011529-d813-47f0-9d4e-1443864f1d65 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.746122] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.746248] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.746885] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.746885] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54011529-d813-47f0-9d4e-1443864f1d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.835131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.835374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.835436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.835712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.835905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.836142] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.836263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.836337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.836594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.837544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.837714] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 964.867856] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.868270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.868270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.869352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.869571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.884103] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 965.106524] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.106689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.106754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.107090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.115361] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.115554] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.115674] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.115934] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.116304] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.116436] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.116525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.117114] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.117290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.117510] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.117626] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.117734] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.117840] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.117948] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.118069] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.118228] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.129961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.130274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.130407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.130469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.130717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.130808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.130904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 965.142105] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.142323] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 965.142459] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.142638] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.143067] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-ba5baf3b-dd35-4519-a241-62cc94164f58 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.143299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.143437] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.143764] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.143933] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5baf3b-dd35-4519-a241-62cc94164f58',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.161914] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.162103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.162179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.162391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.162532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.172796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 965.250030] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.250405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.250620] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.250952] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.251159] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.251340] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 54011529-d813-47f0-9d4e-1443864f1d65 not found, creating... [ 965.251622] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.251824] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.252038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.253049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.253049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.253049] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.253049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.253049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.253313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.253313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.253439] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 54011529-d813-47f0-9d4e-1443864f1d65 is going to be created. [ 965.276816] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.277080] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.277853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.277853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.277853] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.278137] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.647146] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.647567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.647567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.647885] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.648053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.648216] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port ba5baf3b-dd35-4519-a241-62cc94164f58 not found, creating... [ 965.648481] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.648634] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.649162] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.649452] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.649648] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.650064] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.650338] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.650503] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.650834] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.651072] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.651271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: ba5baf3b-dd35-4519-a241-62cc94164f58 is going to be created. [ 965.676388] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.676709] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.676859] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.677234] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.677429] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.677709] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.001127] env[65353]: INFO networking_nsxv3.common.synchronization [req-5bf30681-963c-4a71-b73b-169de4fa92a1 req-e77f8b70-27e0-4b50-a735-89f01b13d757 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 966.001351] env[65353]: INFO networking_nsxv3.common.synchronization [req-5bf30681-963c-4a71-b73b-169de4fa92a1 req-e77f8b70-27e0-4b50-a735-89f01b13d757 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 966.001485] env[65353]: INFO networking_nsxv3.common.synchronization [req-5bf30681-963c-4a71-b73b-169de4fa92a1 req-e77f8b70-27e0-4b50-a735-89f01b13d757 service nova] Enqueued Resource ID: 54011529-d813-47f0-9d4e-1443864f1d65 with Priority: HIGHEST for action port [ 966.001928] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 966.002098] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 966.002221] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54011529-d813-47f0-9d4e-1443864f1d65 with Priority: HIGHEST for action port [ 966.002564] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.002808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.002808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.003045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.003045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.004369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.004369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.004619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-54011529-d813-47f0-9d4e-1443864f1d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.004729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.004811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.005016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.005120] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54011529-d813-47f0-9d4e-1443864f1d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [req-46e4bd50-43d3-4a0e-8a51-65592921544b req-e9f827ec-54b4-4704-8e77-67d9bdee4ae3 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [req-46e4bd50-43d3-4a0e-8a51-65592921544b req-e9f827ec-54b4-4704-8e77-67d9bdee4ae3 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [req-46e4bd50-43d3-4a0e-8a51-65592921544b req-e9f827ec-54b4-4704-8e77-67d9bdee4ae3 service nova] Enqueued Resource ID: ba5baf3b-dd35-4519-a241-62cc94164f58 with Priority: HIGHEST for action port [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 966.396658] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5baf3b-dd35-4519-a241-62cc94164f58 with Priority: HIGHEST for action port [ 966.397353] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.397680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.397842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.398999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.401183] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.401183] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.401183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.401420] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5baf3b-dd35-4519-a241-62cc94164f58 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.401420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.401512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.401639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.401713] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5baf3b-dd35-4519-a241-62cc94164f58',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.506657] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.506800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.506977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54011529-d813-47f0-9d4e-1443864f1d65 with status ACTIVE [ 966.507160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.507267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.507330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.507536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.507623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.507794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.507882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.507935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.508100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.508183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.508344] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.508445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.508499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.508620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.508698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.508771] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54011529-d813-47f0-9d4e-1443864f1d65 is going to be updated. [ 966.531408] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.531629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.531629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.531800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.531935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.532138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54011529-d813-47f0-9d4e-1443864f1d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.608157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 966.608380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.896847] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 966.900268] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.900268] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.900268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.901606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.901714] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.904753] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.904753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.905166] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba5baf3b-dd35-4519-a241-62cc94164f58 with status ACTIVE [ 966.905418] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.905568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.905656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.905951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.906042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.906340] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.906429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.906467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.906659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.906882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.907403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.907633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.907728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.907919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.908030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.908614] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba5baf3b-dd35-4519-a241-62cc94164f58 is going to be updated. [ 966.944052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.944280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.944359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.944542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.944683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.944835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5baf3b-dd35-4519-a241-62cc94164f58" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.072065] env[65353]: INFO networking_nsxv3.common.synchronization [req-d1be4b2d-4c31-4f42-8619-23a1e9307fe7 req-164b50e4-3cb8-40b1-bb1b-9d757baee901 tempest-ServersAdminNegativeTestJSON-2083378065 tempest-ServersAdminNegativeTestJSON-2083378065-project-member] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 967.072770] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 967.073908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.074191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.074433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.074544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.074727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.074830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.074895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.075066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.075143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.075242] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.183194] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 967.183385] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 deletion is rescheduled due to dependency. [ 967.183506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.183666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.183905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.184170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.184346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.184411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.184570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.184672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.184768] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.404448] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.409107] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.409311] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.409441] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.409701] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.410553] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.410553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.410553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.411219] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.411219] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.411219] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.411219] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.411478] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.411478] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.411598] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.411726] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.411881] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.434037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.434037] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.434037] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.434037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.435330] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-7ca39561-6c9a-4644-a6dd-c56d45e12961 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.435330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.435330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.435330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.435330] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca39561-6c9a-4644-a6dd-c56d45e12961',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.579014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.579014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.579014] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 already deleted. [ 967.579014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.687837] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.907030] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.938293] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.938293] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.938495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.938822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.940096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.940096] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 7ca39561-6c9a-4644-a6dd-c56d45e12961 not found, creating... [ 967.940096] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.940096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.940096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.940549] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.940549] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.940917] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.941151] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.941322] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.941642] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.941854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.942053] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 7ca39561-6c9a-4644-a6dd-c56d45e12961 is going to be created. [ 967.964497] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.964795] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.965017] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.965245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.965519] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.965831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.189665] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.410139] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.410139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.410139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.410288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.411036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.411036] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 968.449630] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.452032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.452032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.452032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.452032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.462243] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 968.692739] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.692739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.692888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.693148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.693148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.693322] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 968.729357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.729357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.729357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.729357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.729533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.735359] env[65353]: INFO networking_nsxv3.common.synchronization [req-d1be4b2d-4c31-4f42-8619-23a1e9307fe7 req-6baac759-c434-4cd7-984d-a00132f9310e service nova] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_rules [ 968.735506] env[65353]: INFO networking_nsxv3.common.synchronization [req-d1be4b2d-4c31-4f42-8619-23a1e9307fe7 req-6baac759-c434-4cd7-984d-a00132f9310e service nova] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 968.735588] env[65353]: INFO networking_nsxv3.common.synchronization [req-d1be4b2d-4c31-4f42-8619-23a1e9307fe7 req-6baac759-c434-4cd7-984d-a00132f9310e service nova] Enqueued Resource ID: 7ca39561-6c9a-4644-a6dd-c56d45e12961 with Priority: HIGHEST for action port [ 968.736173] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_rules [ 968.736359] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 968.736359] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca39561-6c9a-4644-a6dd-c56d45e12961 with Priority: HIGHEST for action port [ 968.736559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.736671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.736737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.736988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.737077] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.738300] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.738450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.738514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.738655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.738794] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.738993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.738993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.739127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.739177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.739248] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.742494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ca39561-6c9a-4644-a6dd-c56d45e12961 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.742707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.742824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.743114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.743250] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca39561-6c9a-4644-a6dd-c56d45e12961',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.752633] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 969.246606] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ca39561-6c9a-4644-a6dd-c56d45e12961 with status ACTIVE [ 969.247354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.248632] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.248632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.249177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.249177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.249177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.249177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.250143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.250143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.250143] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ca39561-6c9a-4644-a6dd-c56d45e12961 is going to be updated. [ 969.251466] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.252886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.253180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.280289] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.280589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.280589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.280740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.281154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.281154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ca39561-6c9a-4644-a6dd-c56d45e12961" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.755436] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.948017] env[65353]: INFO networking_nsxv3.common.synchronization [req-5b66b401-c8ff-43dc-8336-59700c0d24d0 req-5a4e9c8f-d04b-40c3-a8dd-d58a74b52d68 tempest-ImagesTestJSON-1941304871 tempest-ImagesTestJSON-1941304871-project-member] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 969.948667] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGHEST for action security_group_members [ 969.949420] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.949646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.949793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.950116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.952288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.952751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.952925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.955904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.956126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.956293] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.258287] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.258618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.258618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.258877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.259063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.259257] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be created. [ 970.290255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.290505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.290505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.290686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.290855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.301934] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: UNINITIALIZED for 2s [ 970.459828] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.460022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.460083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.460336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.460418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.460633] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.460743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.460837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.461098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.461098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.461196] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be updated. [ 970.472518] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 970.472747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.473340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.473340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.473539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.473539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.473539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.473690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.473772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.473857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.473948] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.504088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.504088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.504088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.504395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.504465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.515744] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: IN_PROGRESS for 2s [ 970.764389] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 970.764606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.764781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.764989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.765250] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.765365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.765427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.765605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.765688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.766114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.766114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.977050] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.977275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.977326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.977525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.977710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.977812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.977876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.978091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.978124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.978207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.978360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.978495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.978561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.978709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.978930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.978930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.979094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.979160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.979238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.979317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.979451] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.162913] env[65353]: INFO networking_nsxv3.common.synchronization [req-22e7a72b-b30c-4f41-9151-26e065c01a4a req-08352cb6-06e2-46b9-838a-28006e89f660 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 971.163468] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 971.163772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.164188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.164282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.164487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.164644] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.164745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.164827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.164979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.165099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.165215] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.268517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.268890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.268890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.268987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.269253] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.269253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.269431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.269483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.269548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.269634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.269826] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.269895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.269943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.270103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.270210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.270305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.270305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.270461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.270523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.270560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.270630] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.472178] env[65353]: INFO networking_nsxv3.common.synchronization [None req-d4765ec3-e082-4218-bc05-e139f59c228d tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 971.473894] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 971.473894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.473894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.473894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.473894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.473894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.474251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.474251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.474333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.474369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.475914] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.484345] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 971.501863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.502077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.502160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.502309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.502393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.502612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.502741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.502785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.502915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.502990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.503228] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.503326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.503386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.503578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.503631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.503779] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.503870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.503926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.504263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.504400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.504490] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 971.576860] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.576860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.576860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.576860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.576860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.594077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 971.667981] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.668191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.668264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.668498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.668658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.668933] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.669058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.669127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.669293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.669545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.669649] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 971.715387] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.715612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.715718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.716821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.716821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.728171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 971.773041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e718fc6-a572-4276-83ab-0e7e530140d0: rpc.has_security_group_logging(os_id): False [ 971.811276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.811470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.811470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.811763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.812346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.812346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.812346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.812346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.812621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.812621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.812766] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.812883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.812942] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.813096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.813168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.813370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.813465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.813508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.813649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.813721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.813803] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 971.904381] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.904575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.904575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.905606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.905606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.923960] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 971.977207] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.312811] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 972.312811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.312811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.312811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.313495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.313495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.313495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.313495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.313495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.313495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.313713] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.479068] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.527103] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef90e1f-f512-4c74-82f2-c918b64f5aee in Status: SUCCESS [ 972.527314] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee deletion is rescheduled due to dependency. [ 972.527427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.816839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.816839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.816839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.817020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.817224] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.817299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.817344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.817490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.817577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.817661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.817815] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.817906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.817960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.818114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.818257] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.818347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.818401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.818536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.818609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.818688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.818774] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.981252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.981412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.981480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.981693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.981789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.981888] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 973.010881] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.011163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.011163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.011298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.011442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.020619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 973.323565] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6: rpc.has_security_group_logging(os_id): False [ 973.344022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.344022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.344022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.344022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.344022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.344398] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.344448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.344479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.345181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.345181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.345181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.345181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.345181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.345414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.345414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.345750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.345750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.345750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.346143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.346143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.346143] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be created. [ 973.416921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.417063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.417167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.417464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.418191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.428502] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 973.606594] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 973.606759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.739459] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 973.739705] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 973.739826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.792613] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.792847] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.792999] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.793299] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.793621] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.793846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.793971] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.794343] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.794522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.794833] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.794943] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.795123] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.795352] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.795417] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.795546] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.795693] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.834489] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.834786] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.835046] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.835414] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.835820] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-b5674f8b-143e-42c8-b72a-dd062de31bdc taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.836097] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.836207] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.836534] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.836752] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5674f8b-143e-42c8-b72a-dd062de31bdc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.943445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 973.943734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.339903] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.340298] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.340298] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.340560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.340715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.340866] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port b5674f8b-143e-42c8-b72a-dd062de31bdc not found, creating... [ 974.341134] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.341288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.341401] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.341620] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.341756] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.342219] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.342447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.342616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.342869] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.343070] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.343267] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: b5674f8b-143e-42c8-b72a-dd062de31bdc is going to be created. [ 974.367259] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.367554] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.367707] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.367972] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.368219] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.368440] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.033971] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 975.034366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.092982] env[65353]: INFO networking_nsxv3.common.synchronization [req-08416bcd-91bb-4458-bede-49e2c4f5a4f4 req-412a6a81-73c3-425e-b932-1e21fc0c8205 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 975.092982] env[65353]: INFO networking_nsxv3.common.synchronization [req-08416bcd-91bb-4458-bede-49e2c4f5a4f4 req-412a6a81-73c3-425e-b932-1e21fc0c8205 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 975.093123] env[65353]: INFO networking_nsxv3.common.synchronization [req-08416bcd-91bb-4458-bede-49e2c4f5a4f4 req-412a6a81-73c3-425e-b932-1e21fc0c8205 service nova] Enqueued Resource ID: b5674f8b-143e-42c8-b72a-dd062de31bdc with Priority: HIGHEST for action port [ 975.093832] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 975.094020] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 975.094253] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5674f8b-143e-42c8-b72a-dd062de31bdc with Priority: HIGHEST for action port [ 975.096351] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.096351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.096351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.097100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.097100] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.102729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.102729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.102729] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.102729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5674f8b-143e-42c8-b72a-dd062de31bdc taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.102729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.103634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.103634] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5674f8b-143e-42c8-b72a-dd062de31bdc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.448653] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 975.449060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.497802] env[65353]: INFO networking_nsxv3.common.synchronization [req-520fe491-a982-400f-a2e3-9fe7e4e8b277 req-98a44f8f-23af-4373-ae5c-4dadc2887d09 tempest-ServersTestBootFromVolume-150012720 tempest-ServersTestBootFromVolume-150012720-project-member] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 975.498353] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 975.498661] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.498777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.498846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.499570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.499806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.499944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.500035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.500190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.500282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.500406] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.608495] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.608495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.608495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.608495] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5674f8b-143e-42c8-b72a-dd062de31bdc with status ACTIVE [ 975.608495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.608495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.608495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.608495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.608495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.608495] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.609614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.610013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.610481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.610829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.611369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.611743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.611990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.612371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.613257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.615109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5674f8b-143e-42c8-b72a-dd062de31bdc is going to be updated. [ 975.638284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.638284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.638284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.638284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.638284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.638284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5674f8b-143e-42c8-b72a-dd062de31bdc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.977779] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.978643] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-586" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.978643] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-586" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.979066] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-586" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.979439] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.979702] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.979907] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.980457] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.980571] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.981048] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.981254] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.981456] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.981638] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.981822] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.982016] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.982236] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.001945] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.002141] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.002328] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.002522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-586" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.002833] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.003090] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.003195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.003522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.003666] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd8957b-60d8-46f7-a8f4-a3f60d74d925',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.004702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.004816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.004900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.005073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.005139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.005345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.005545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.005545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.005624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.005693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.005778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 already deleted. [ 976.005855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.107337] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.509553] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.509553] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 not found, creating... [ 976.509553] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.509553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.510184] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.510184] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.510184] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.513328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.514160] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.514489] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 is going to be created. [ 976.538048] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.538048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.538048] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.538285] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.538323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.539069] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.609617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.609807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.609807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.610187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.610259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.610371] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 976.646424] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.646572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.646642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.646876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.646992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.656420] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 977.241121] env[65353]: INFO networking_nsxv3.common.synchronization [req-520fe491-a982-400f-a2e3-9fe7e4e8b277 req-7df00ccb-96c7-42d7-a62f-4ac45662265b service nova] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 977.241310] env[65353]: INFO networking_nsxv3.common.synchronization [req-520fe491-a982-400f-a2e3-9fe7e4e8b277 req-7df00ccb-96c7-42d7-a62f-4ac45662265b service nova] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 977.241448] env[65353]: INFO networking_nsxv3.common.synchronization [req-520fe491-a982-400f-a2e3-9fe7e4e8b277 req-7df00ccb-96c7-42d7-a62f-4ac45662265b service nova] Enqueued Resource ID: 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 with Priority: HIGHEST for action port [ 977.241726] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_rules [ 977.241801] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 977.241897] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 with Priority: HIGHEST for action port [ 977.242504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.242628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.242691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.242892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.242971] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.245069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.245194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.245269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.245419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.245570] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.245710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.245710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.245857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.245959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.246091] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.247625] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.247625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.247625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.247625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.247625] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd8957b-60d8-46f7-a8f4-a3f60d74d925',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.749272] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.749676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.749676] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.750796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 with status ACTIVE [ 977.751063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.751189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.751251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.751830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.751830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.752031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.752031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.752188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.752393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.752503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.752706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.752826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.752884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.753045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.753117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.753199] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fd8957b-60d8-46f7-a8f4-a3f60d74d925 is going to be updated. [ 977.779205] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.779525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.779564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.779858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.780057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.786678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd8957b-60d8-46f7-a8f4-a3f60d74d925" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.255672] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.323260] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.323454] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.323597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.323890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.324342] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.324534] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.325041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.325041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.325041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.325371] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.325371] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.325478] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.325598] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.325699] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.325815] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.325927] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.347018] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.347018] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.347018] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.347018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.347018] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.347018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.347018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.347018] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.347018] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df45cdcb-d09e-4cf8-9b86-0550872fa9ee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.672024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.674216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.674216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.674489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.674489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.674547] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.758617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.758995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.758995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.759297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.759427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.759563] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 is going to be created. [ 978.788554] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.788729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.788786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.789306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.789306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.802727] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: UNINITIALIZED for 2s [ 978.850309] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.850567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.850698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.850993] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.851174] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.851503] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.851669] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.851786] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.852027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.852235] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.852554] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.852717] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.852835] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.853061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.853203] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.853383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee is going to be updated. [ 978.878764] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.878764] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.878764] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.878764] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.879399] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.879504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.177035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.177035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.177035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.177035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.177437] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.177437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.177437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.177554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.177590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.177670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.177818] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.177912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.177968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.178127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.178277] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.178367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.178426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.178562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.178634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.178712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.178797] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.655918] env[65353]: INFO networking_nsxv3.common.synchronization [req-6889ece9-30f4-4181-b7f9-e24920476370 req-ff0aa947-789e-42d5-8ef5-a05c5150961d service nova] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 979.656313] env[65353]: INFO networking_nsxv3.common.synchronization [req-6889ece9-30f4-4181-b7f9-e24920476370 req-ff0aa947-789e-42d5-8ef5-a05c5150961d service nova] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 979.656488] env[65353]: INFO networking_nsxv3.common.synchronization [req-6889ece9-30f4-4181-b7f9-e24920476370 req-ff0aa947-789e-42d5-8ef5-a05c5150961d service nova] Enqueued Resource ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee with Priority: HIGHEST for action port [ 979.656992] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_rules [ 979.657195] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 979.657381] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee with Priority: HIGHEST for action port [ 979.657702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.657869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.657920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.658192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.658334] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.659554] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.659554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.659698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.659844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.660080] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.662049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.662133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.662476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.662513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.662622] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.664466] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.664466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.664466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.664466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.664466] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df45cdcb-d09e-4cf8-9b86-0550872fa9ee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.681387] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e718fc6-a572-4276-83ab-0e7e530140d0: rpc.has_security_group_logging(os_id): False [ 979.701810] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.702042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.702042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.702269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.702403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.702660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.702786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.702866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.703080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.703181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.703445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.703569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.703652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.703831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.703931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.704238] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.704364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.704447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.704633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.704730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.704844] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 979.774835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.775273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.775273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.775367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.775455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.793408] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 980.166411] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.166588] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.166784] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.167765] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df45cdcb-d09e-4cf8-9b86-0550872fa9ee with status ACTIVE [ 980.168049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.168168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.168235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.168442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.168546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.168706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.168800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.168858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.169014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.169289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.169492] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.169600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.169681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.169799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.169873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.169955] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df45cdcb-d09e-4cf8-9b86-0550872fa9ee is going to be updated. [ 980.190839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.190984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.191058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.191296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.191386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.191538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df45cdcb-d09e-4cf8-9b86-0550872fa9ee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.672214] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.815512] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: SUCCESS [ 980.815897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.816538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.816538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.816538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.816823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.816823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.816924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.817169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.817169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.817282] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.174770] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.174930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.175019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.175278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.175381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.175498] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be updated. [ 981.209026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.209176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.209176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.209383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.209520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.219543] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: IN_PROGRESS for 2s [ 981.382256] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.813311] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 981.813842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.825041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ebabbee-f94a-4795-9ff8-41a9c6c02592: rpc.has_security_group_logging(os_id): False [ 981.847191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.847383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.847383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.847606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.847704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.847968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.848086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.848150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.848314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.848449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.848485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 is going to be created. [ 981.941219] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.941219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.941219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.941219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.941520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.954221] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: IN_PROGRESS for 2s [ 983.230916] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: SUCCESS [ 983.231870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.231870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.231870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.231870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.231870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.231870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.232216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.232216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.232216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.232216] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.738423] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.971785] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: SUCCESS [ 983.973973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.240376] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5171ec2a-8acc-4736-a34b-cf763dc5c9f7: rpc.has_security_group_logging(os_id): False [ 984.259674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.259821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.259892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.260128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.283889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.283889] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.283889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.283889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.283889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.284116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.284116] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be updated. [ 984.358723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.358723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.358723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.358723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.358723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.374856] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: IN_PROGRESS for 2s [ 984.658726] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 984.658840] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 986.393017] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: SUCCESS [ 986.393365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.709331] env[65353]: INFO networking_nsxv3.common.synchronization [req-36b40883-1164-40a3-8194-c7513f26dc7f req-f62971a5-5dbd-4fec-b8f1-5b45d1e05733 tempest-ServersV294TestFqdnHostnames-598803872 tempest-ServersV294TestFqdnHostnames-598803872-project-member] Enqueued Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 986.709331] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 with Priority: HIGHEST for action security_group_members [ 986.709331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-357b71ae-4236-49a4-9cb3-5cec4c42e443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.709331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.709331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.709331] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('357b71ae-4236-49a4-9cb3-5cec4c42e443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.212666] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.212666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.212666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.212890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.212941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.213181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.213293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.213637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.213637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.213637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.213769] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 is going to be updated. [ 987.245279] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.245364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.245551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.247026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.247026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.260061] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: IN_PROGRESS for 2s [ 987.572271] env[65353]: INFO networking_nsxv3.common.synchronization [req-aedbc5af-9627-49d2-a363-bd4da255a6bb req-85e5e2bd-7a5f-496e-9681-449e3a52cdb7 tempest-ServerRescueTestJSON-1182933684 tempest-ServerRescueTestJSON-1182933684-project-member] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 987.573272] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 987.577041] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.577041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.577041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.577421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.577511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.577582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.577661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.577951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.577951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.578130] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.741372] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0ac821ab-6038-4e24-bf55-9ed376428cbc None None] Enqueued Resource ID: 655fc475-afa2-41df-9991-7e4f6e9f8856 with Priority: HIGHEST for action port [ 987.741372] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655fc475-afa2-41df-9991-7e4f6e9f8856 with Priority: HIGHEST for action port [ 987.741372] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-655fc475-afa2-41df-9991-7e4f6e9f8856 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.741372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-655fc475-afa2-41df-9991-7e4f6e9f8856" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.741372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-655fc475-afa2-41df-9991-7e4f6e9f8856" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.742965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-655fc475-afa2-41df-9991-7e4f6e9f8856" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.743424] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('655fc475-afa2-41df-9991-7e4f6e9f8856',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.081893] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.245424] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 655fc475-afa2-41df-9991-7e4f6e9f8856 [ 988.245700] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.245808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.245855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.246091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.246182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.246283] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:655fc475-afa2-41df-9991-7e4f6e9f8856 already deleted. [ 988.246364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-655fc475-afa2-41df-9991-7e4f6e9f8856" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.482370] env[65353]: INFO networking_nsxv3.common.synchronization [None req-bfb1bcb6-8dc2-4968-acdd-54670957e553 tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 988.482370] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 988.482370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.482370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.482370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.482870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.483193] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.589036] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.635165] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1de590ee-d3ef-4b4e-b5e5-2235e94292e0 tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 988.635853] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 988.636783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.636921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.012477] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.012705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.012752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.013047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.013183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.013341] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb already deleted. [ 989.013461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.013674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.013904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.014032] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.092168] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.092410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.092410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.092617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.092712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.093118] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be updated. [ 989.126730] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.127022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.127269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.127269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.127433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.139730] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 989.274260] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 in Status: SUCCESS [ 989.274441] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 357b71ae-4236-49a4-9cb3-5cec4c42e443 deletion is rescheduled due to dependency. [ 989.274560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-357b71ae-4236-49a4-9cb3-5cec4c42e443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.537331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.537516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.537557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.537903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.537903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.538090] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb already deleted. [ 989.538360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.150996] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 991.151340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.212775] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2b9fb8ce-41e3-46e5-8a13-8ad42fe7ae04 None None] Enqueued Resource ID: 4540763e-4d62-448a-b8eb-76c666a4f625 with Priority: HIGHEST for action port [ 991.213339] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4540763e-4d62-448a-b8eb-76c666a4f625 with Priority: HIGHEST for action port [ 991.213731] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4540763e-4d62-448a-b8eb-76c666a4f625 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.213854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4540763e-4d62-448a-b8eb-76c666a4f625" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.213931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4540763e-4d62-448a-b8eb-76c666a4f625" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.214279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4540763e-4d62-448a-b8eb-76c666a4f625" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.214414] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4540763e-4d62-448a-b8eb-76c666a4f625',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.717024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4540763e-4d62-448a-b8eb-76c666a4f625 [ 991.717639] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.717814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.717890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.718090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.718189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.718324] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4540763e-4d62-448a-b8eb-76c666a4f625 already deleted. [ 991.718379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4540763e-4d62-448a-b8eb-76c666a4f625" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.910589] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ca1c7854-9c45-4dc4-988b-270ff8283761 None None] Enqueued Resource ID: 56e2af79-dcec-4865-ae3e-b309416ba4f2 with Priority: HIGHEST for action port [ 992.911152] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e2af79-dcec-4865-ae3e-b309416ba4f2 with Priority: HIGHEST for action port [ 992.912048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e2af79-dcec-4865-ae3e-b309416ba4f2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.912048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e2af79-dcec-4865-ae3e-b309416ba4f2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.912048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e2af79-dcec-4865-ae3e-b309416ba4f2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.912048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e2af79-dcec-4865-ae3e-b309416ba4f2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.912048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e2af79-dcec-4865-ae3e-b309416ba4f2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.149557] env[65353]: INFO networking_nsxv3.common.synchronization [req-a2773bc1-e15b-4fae-a308-4d25aa0a44b5 req-100ae976-4696-43a7-99b3-06b6a8aee4cc tempest-ServersAdminNegativeTestJSON-2083378065 tempest-ServersAdminNegativeTestJSON-2083378065-project-member] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 993.149845] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 993.150151] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.150260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.150778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.150778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.150778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.150948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.150948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.152061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.152061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.152061] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.416207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56e2af79-dcec-4865-ae3e-b309416ba4f2 [ 993.416447] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.416572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.416636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.416917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.417017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.417143] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56e2af79-dcec-4865-ae3e-b309416ba4f2 already deleted. [ 993.417215] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e2af79-dcec-4865-ae3e-b309416ba4f2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.531651] env[65353]: INFO networking_nsxv3.common.synchronization [req-2f8ce0ee-c8f2-4f75-843d-83252860ecb6 req-fbb888ed-9b0e-4646-8be6-c18a9c13ded1 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 993.532132] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 993.532490] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.532629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.532736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.532915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.533091] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.533195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.533255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.533414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.533481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.533564] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.617255] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.617255] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.617502] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.617548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.619783] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.619783] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.619783] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.619783] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.619783] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.619783] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.619783] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.619783] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.619783] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.619783] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.619783] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.619783] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.643048] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.644053] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.644053] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.644053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-382" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.644277] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-60d17121-d4ab-476b-b4a9-1852a80b9535 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.644535] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.644714] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.645106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.645843] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60d17121-d4ab-476b-b4a9-1852a80b9535',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.656500] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.036968] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.151707] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.151985] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.152074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.152895] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.152895] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.152895] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 60d17121-d4ab-476b-b4a9-1852a80b9535 not found, creating... [ 994.153059] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.153221] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.153343] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.153590] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.153723] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.154018] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.154687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.154819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.155041] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.158958] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.158958] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 60d17121-d4ab-476b-b4a9-1852a80b9535 is going to be created. [ 994.163777] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.180270] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.180746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.180896] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.181182] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.181447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.181696] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.200808] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a7bb6c65-1b6c-4175-b865-59f8b84e54b3 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 994.201412] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 994.201734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.201836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.538729] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.624549] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3b909d6a-1c27-469e-bc8e-0abd5231d4aa tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 994.624549] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 994.624549] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.624549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.624549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.624549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.625095] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.666951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.667467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.667467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.667467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.667755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.667755] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be updated. [ 994.701870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.702102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.702102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.702357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.702502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.712989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 994.777513] env[65353]: INFO networking_nsxv3.common.synchronization [None req-504cde27-e2ad-403f-b95d-d26cc4a28f11 tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 994.778253] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 994.778747] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.778912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.929575] env[65353]: INFO networking_nsxv3.common.synchronization [req-a2773bc1-e15b-4fae-a308-4d25aa0a44b5 req-bab882a0-2bd4-4790-ad51-a1074c829e36 service nova] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_rules [ 994.929815] env[65353]: INFO networking_nsxv3.common.synchronization [req-a2773bc1-e15b-4fae-a308-4d25aa0a44b5 req-bab882a0-2bd4-4790-ad51-a1074c829e36 service nova] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 994.930075] env[65353]: INFO networking_nsxv3.common.synchronization [req-a2773bc1-e15b-4fae-a308-4d25aa0a44b5 req-bab882a0-2bd4-4790-ad51-a1074c829e36 service nova] Enqueued Resource ID: 60d17121-d4ab-476b-b4a9-1852a80b9535 with Priority: HIGHEST for action port [ 994.930479] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_rules [ 994.930610] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 994.930707] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d17121-d4ab-476b-b4a9-1852a80b9535 with Priority: HIGHEST for action port [ 994.930975] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.932155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.932757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.932996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.933104] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.933986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.934113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.934299] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-60d17121-d4ab-476b-b4a9-1852a80b9535 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.934467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.934527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.934699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.934774] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60d17121-d4ab-476b-b4a9-1852a80b9535',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.042618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.042907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.042907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.043016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.043118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.043221] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 995.075158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.075298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.075355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.076043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.076043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.087117] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 995.147254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.147543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.147641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.148227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.148227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.148227] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a already deleted. [ 995.148227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.148457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.148587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.148790] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.151943] env[65353]: INFO networking_nsxv3.common.synchronization [None req-6287c8f7-4b2c-4d5b-9ca2-e759dc9c570e None None] Enqueued Resource ID: 6d059879-6f52-4d12-8e78-1369dcbb2172 with Priority: HIGHEST for action port [ 995.152892] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d059879-6f52-4d12-8e78-1369dcbb2172 with Priority: HIGHEST for action port [ 995.154258] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d059879-6f52-4d12-8e78-1369dcbb2172 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.154258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d059879-6f52-4d12-8e78-1369dcbb2172" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.154258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d059879-6f52-4d12-8e78-1369dcbb2172" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.154258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d059879-6f52-4d12-8e78-1369dcbb2172" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.154258] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d059879-6f52-4d12-8e78-1369dcbb2172',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.436580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.436998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.441334] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60d17121-d4ab-476b-b4a9-1852a80b9535 with status ACTIVE [ 995.441334] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.441334] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.441334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.441708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.441708] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.441708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.441708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.441833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.441908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.441946] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60d17121-d4ab-476b-b4a9-1852a80b9535 is going to be updated. [ 995.469903] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.469903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.469903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.469903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.469903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.469903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60d17121-d4ab-476b-b4a9-1852a80b9535" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.657306] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d059879-6f52-4d12-8e78-1369dcbb2172 [ 995.657306] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.657306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.657306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.657478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.657571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.657666] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d059879-6f52-4d12-8e78-1369dcbb2172 already deleted. [ 995.657745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d059879-6f52-4d12-8e78-1369dcbb2172" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.671945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.672125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.675045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.675045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.675045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.675045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a already deleted. [ 995.675045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.938223] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.938429] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.938540] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.938804] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.939070] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.939228] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.939345] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.939574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.939731] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.939948] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.940071] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.940179] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.940286] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.940395] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.940500] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.940629] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.961394] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.961594] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.961759] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.962297] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-744" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.962297] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.962518] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.962574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.962848] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.963052] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.466528] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.467008] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.468577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.468577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.468577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.468577] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.468833] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.468969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.469914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.470892] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.470892] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.470892] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.470892] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.471151] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.471243] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.471416] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 is going to be updated. [ 996.494666] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.494849] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.494955] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.495207] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.495413] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.495661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.723244] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 996.723488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.723661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.723873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.724075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.724192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.724261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.724471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.724613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.724658] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.097125] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 997.097346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.097513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.097729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.097916] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.098332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.098332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.098332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.098577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.098577] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.226790] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.247677] env[65353]: INFO networking_nsxv3.common.synchronization [req-1bf512fa-d62c-441a-9b62-1e0845b9a853 req-5a3d392d-ac3a-49af-ad31-11d1a3ea0056 service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 997.247853] env[65353]: INFO networking_nsxv3.common.synchronization [req-1bf512fa-d62c-441a-9b62-1e0845b9a853 req-5a3d392d-ac3a-49af-ad31-11d1a3ea0056 service nova] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 997.247998] env[65353]: INFO networking_nsxv3.common.synchronization [req-1bf512fa-d62c-441a-9b62-1e0845b9a853 req-5a3d392d-ac3a-49af-ad31-11d1a3ea0056 service nova] Enqueued Resource ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with Priority: HIGHEST for action port [ 997.248727] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_rules [ 997.249329] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 997.249329] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with Priority: HIGHEST for action port [ 997.249790] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.249790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.249933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.250225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.250356] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.251258] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.251351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.251396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.251572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.251886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.251886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.251886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.252044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.252876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.252983] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.254052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.254161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.254525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.254845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.254929] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.602018] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.602018] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.602018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.602679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.602679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.602679] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 997.641511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.642028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.642028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.642028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.642301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.654667] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 997.729652] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.756916] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.757951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.758125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.758248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 with status ACTIVE [ 997.758382] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.758488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.758551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.758750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.758838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.759038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.759202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.759202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.759316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.759388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.759565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.759652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.759766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.759908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.759908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.759983] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321 is going to be updated. [ 997.782963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.783164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.783210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.783388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.783525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.783689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc8b3d1a-d7ea-4c53-9dcb-b5bcd1288321" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.966169] env[65353]: INFO networking_nsxv3.common.synchronization [req-9efbd7c7-b6c5-44c9-b01b-ba76d7e0c4b9 req-4dbdc3d5-f91c-4dde-8e43-a1eb6e34176e tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 997.968436] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGHEST for action security_group_members [ 997.968714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.968861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.968928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.971406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.971406] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.971406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.971406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.971406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.971406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.971406] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.231032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.231032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.231235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.231472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.231472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.231641] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be updated. [ 998.262711] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.268128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.268128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.268128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.268128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.268128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.280463] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 998.473318] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.473502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.473557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.473760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.473840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.474051] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.474274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.474274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.474471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.474511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.474760] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 069ced97-9b0a-489d-acf5-0da342604329 is going to be updated. [ 998.509145] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.509627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.509718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.509983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.510284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.522401] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: IN_PROGRESS for 2s [ 998.766114] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.766502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.766502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.768363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.769232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.769472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 998.839099] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.839099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.839099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.839099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.839099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.861134] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 999.666557] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 999.666782] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 deletion is rescheduled due to dependency. [ 999.666910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.290712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 1000.291057] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.292543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.292543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.292543] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.292543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.292543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.293314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.293496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.294700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.294700] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.534433] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 069ced97-9b0a-489d-acf5-0da342604329 in Status: SUCCESS [ 1000.534433] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 069ced97-9b0a-489d-acf5-0da342604329 deletion is rescheduled due to dependency. [ 1000.534433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.796847] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.797115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.797201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.797697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.797697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.797697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.798583] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.798583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.798810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.798840] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.799087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.799087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.799258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.799379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.800189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.800189] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.881980] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3817986-90b5-4afd-98e6-dcfcec94efb6 req-ae8c8f7e-981d-478d-a11b-83b7062de529 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1000.882900] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1000.884872] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.884872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.885654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.885654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.885654] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.885885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.885950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.886566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.886566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.886717] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.889800] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 1000.889800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.889800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.889800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.890247] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.890247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.890247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.890398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.890644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.890644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.890730] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.302522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6: rpc.has_security_group_logging(os_id): False [ 1001.322894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.323320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.323320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.323481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.323481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.323726] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.324491] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.324491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.324709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.324843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.324949] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.325063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.325121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.325310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.325398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.325457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be updated. [ 1001.391981] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.392155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.392264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.392525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.393100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.394305] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.394305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.394491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.394634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.394721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.394906] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.395011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.395084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.395228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.395297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.395463] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1001.396661] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.396783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.396882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.396970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.397124] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.397218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.397283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.397485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.397584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.397668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.397815] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.397906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.397966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.398119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.398255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.398345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.398464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.398639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.398674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.398745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.398833] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.420293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 1001.430661] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.430950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.431143] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.431291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.431502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.441733] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1001.901431] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28dd6d0-e311-4f5d-a6ed-59453af2dcc0: rpc.has_security_group_logging(os_id): False [ 1001.927621] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.927887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.927887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.928202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.928321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.928547] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.928650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.928712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.928944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.929095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.929397] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.929511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.929632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.929869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.929964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.930197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.930296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.930368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.930585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.930739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.930909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 1002.023023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.023230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.023230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.023552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.023788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.054603] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 1002.351632] env[65353]: INFO networking_nsxv3.common.synchronization [req-7d3c2719-d737-40df-90fe-8670d7ad44b7 req-448d0652-e5ff-42b1-82ba-4b44828c3437 tempest-ServersTestFqdnHostnames-1243309972 tempest-ServersTestFqdnHostnames-1243309972-project-member] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 1002.352332] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGHEST for action security_group_members [ 1002.352690] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.352848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.352931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.353287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.353560] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.353770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.353903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.354122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.354248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.354444] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.857858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.858119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.858277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.858520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.884248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.884603] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.884721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.884782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.885198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.885198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.885198] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c is going to be updated. [ 1002.913162] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.913361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.913361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.914055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.914055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.929334] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: IN_PROGRESS for 2s [ 1003.152758] env[65353]: INFO networking_nsxv3.common.synchronization [req-eb12ee37-dd5d-48f2-abba-49daeb47485c req-d1b2cf5f-a651-47d7-8b73-838acd1ad7fd tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1003.153034] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1003.153966] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.153966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.153966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.153966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.153966] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.154253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.154960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.161210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.161210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.161210] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.436276] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 1003.436550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.452032] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1003.452032] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1003.452324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.538870] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f5e5d940-23b9-4776-8e41-1f0e51cbad42 None None] Enqueued Resource ID: 3807eb1f-711c-4da1-a27e-16c741cac334 with Priority: HIGHEST for action port [ 1003.539401] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3807eb1f-711c-4da1-a27e-16c741cac334 with Priority: HIGHEST for action port [ 1003.539709] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-3807eb1f-711c-4da1-a27e-16c741cac334 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.539827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3807eb1f-711c-4da1-a27e-16c741cac334" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.539895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3807eb1f-711c-4da1-a27e-16c741cac334" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.542269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3807eb1f-711c-4da1-a27e-16c741cac334" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.542269] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3807eb1f-711c-4da1-a27e-16c741cac334',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.583653] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-760 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.583653] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.583653] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.585606] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.586146] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.586515] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.586858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.587292] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.587607] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.588028] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.588278] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.588529] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.588852] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.589263] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.589263] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.591068] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.612365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.612365] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.612365] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.612365] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.613303] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-5129824f-97f1-400a-bcc3-83e948d26edd taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.613485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.613588] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.613929] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.614114] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5129824f-97f1-400a-bcc3-83e948d26edd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.662049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.662235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.662313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.662527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.662612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.662817] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.662904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.662973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.663133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.663196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.663292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb already deleted. [ 1003.663409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.043903] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3807eb1f-711c-4da1-a27e-16c741cac334 [ 1004.044951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.044951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.044951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.045109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.045144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.045236] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3807eb1f-711c-4da1-a27e-16c741cac334 already deleted. [ 1004.045337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3807eb1f-711c-4da1-a27e-16c741cac334" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.073131] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 1004.073189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.119099] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.119099] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 5129824f-97f1-400a-bcc3-83e948d26edd not found, creating... [ 1004.119099] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.119099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.120187] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.120745] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.121061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.121483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.121816] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.122130] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 5129824f-97f1-400a-bcc3-83e948d26edd is going to be created. [ 1004.145845] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.146128] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.146356] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.146912] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.148631] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.148631] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.213422] env[65353]: INFO networking_nsxv3.common.synchronization [req-13dd584c-6013-4e7b-88cb-93796bd989a9 req-bf1b62e2-227d-48df-9a12-a19ed6393ec2 tempest-ServerRescueTestJSON-1182933684 tempest-ServerRescueTestJSON-1182933684-project-member] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 1004.214178] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGHEST for action security_group_members [ 1004.214782] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.214914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.214989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.215227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.215459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.215675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.215809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.216023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.216124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.216229] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.720255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.720770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.720770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.720894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.721317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.721727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.721881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.721881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.723049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.723049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.723049] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be updated. [ 1004.757876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.758180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.758180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.758421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.758618] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.770042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: IN_PROGRESS for 2s [ 1004.857564] env[65353]: INFO networking_nsxv3.common.synchronization [req-68850286-527b-4e77-b202-8d9c627da453 req-2ee6a0ca-f5e0-4911-ad20-e96b3ccc9e71 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1004.858387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1004.859519] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.859519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.859742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.859781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.859969] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.860104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.860171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.860337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.860426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.860573] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.929899] env[65353]: INFO networking_nsxv3.common.synchronization [req-eb12ee37-dd5d-48f2-abba-49daeb47485c req-79c77d37-f95c-4a24-9c47-21668a41c46a service nova] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 1004.930100] env[65353]: INFO networking_nsxv3.common.synchronization [req-eb12ee37-dd5d-48f2-abba-49daeb47485c req-79c77d37-f95c-4a24-9c47-21668a41c46a service nova] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1004.931201] env[65353]: INFO networking_nsxv3.common.synchronization [req-eb12ee37-dd5d-48f2-abba-49daeb47485c req-79c77d37-f95c-4a24-9c47-21668a41c46a service nova] Enqueued Resource ID: 5129824f-97f1-400a-bcc3-83e948d26edd with Priority: HIGHEST for action port [ 1004.931201] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_rules [ 1004.931201] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1004.931530] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5129824f-97f1-400a-bcc3-83e948d26edd with Priority: HIGHEST for action port [ 1004.932178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.932363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.932435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.935527] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.935527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.935527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.935527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.935527] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.937689] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5129824f-97f1-400a-bcc3-83e948d26edd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.937689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.937689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.937689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.937689] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5129824f-97f1-400a-bcc3-83e948d26edd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.941391] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2987c0-489b-45df-9694-cf09b0682b7c in Status: SUCCESS [ 1004.941657] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c deletion is rescheduled due to dependency. [ 1004.941822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.364370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.364550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.364645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.371281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.399653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.401059] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.401203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.401255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.401477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.401563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.401808] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1005.439205] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.439832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.439944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.444195] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.444339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.444469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.444680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.444824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.448022] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5129824f-97f1-400a-bcc3-83e948d26edd with status ACTIVE [ 1005.448022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.448022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.448022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.448022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.448022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.448022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.448022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.450404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.452828] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.452828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.452828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.452828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.452828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.452828] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5129824f-97f1-400a-bcc3-83e948d26edd is going to be updated. [ 1005.468631] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1005.485254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.485254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.485254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.485254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.485254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.485254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5129824f-97f1-400a-bcc3-83e948d26edd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.687316] env[65353]: INFO networking_nsxv3.common.synchronization [req-33848949-ad25-47ef-a29e-a9dadc53c26f req-1f8726ab-6760-46d7-8776-bc33d10d5c97 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1005.688294] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1005.688922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.689066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.689133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.689333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.689479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.689576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.689636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.689787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.689868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.689959] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.944358] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.166237] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.166237] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.166237] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.166237] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.166879] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.167133] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.167328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.167704] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.167958] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.168221] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.168412] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.168602] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.168794] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.168988] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.169199] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.169420] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.193350] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.193350] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.193350] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.193350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.194057] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-60781a2e-372f-4466-a612-ab0c21fb5805 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.194342] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.194543] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.194926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.195076] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60781a2e-372f-4466-a612-ab0c21fb5805',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.196136] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.196266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.196323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.196495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.196578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.196760] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.196848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.196905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.197419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.197419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.197419] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1006.225280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.225280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.225449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.225708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.225774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.237997] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1006.413563] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a212a13d-3d07-4f85-a174-dd9a4ae12062 None None] Enqueued Resource ID: 09214b1a-dd05-4d9c-ada4-35f837401fa1 with Priority: HIGHEST for action port [ 1006.413866] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09214b1a-dd05-4d9c-ada4-35f837401fa1 with Priority: HIGHEST for action port [ 1006.414191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-09214b1a-dd05-4d9c-ada4-35f837401fa1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.414308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09214b1a-dd05-4d9c-ada4-35f837401fa1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.414681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09214b1a-dd05-4d9c-ada4-35f837401fa1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.414681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09214b1a-dd05-4d9c-ada4-35f837401fa1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.414765] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09214b1a-dd05-4d9c-ada4-35f837401fa1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.448909] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.448909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.448909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.448909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.448909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.448909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb is going to be created. [ 1006.474538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.475237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.475774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.477582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.477582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.487496] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: UNINITIALIZED for 2s [ 1006.700115] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.700441] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.700611] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.701434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.701434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.701434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 60781a2e-372f-4466-a612-ab0c21fb5805 not found, creating... [ 1006.701843] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.702065] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.702229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.702559] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.706019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.706019] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.706019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.706019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.706019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.706019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.706019] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 60781a2e-372f-4466-a612-ab0c21fb5805 is going to be created. [ 1006.729454] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.729715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.729790] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.730098] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.730354] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.730557] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.783031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad in Status: SUCCESS [ 1006.783212] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad deletion is rescheduled due to dependency. [ 1006.783335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.916976] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09214b1a-dd05-4d9c-ada4-35f837401fa1 [ 1006.917480] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.917637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.917702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.917957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.918526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.918697] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09214b1a-dd05-4d9c-ada4-35f837401fa1 already deleted. [ 1006.918816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09214b1a-dd05-4d9c-ada4-35f837401fa1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.468314] env[65353]: INFO networking_nsxv3.common.synchronization [req-33848949-ad25-47ef-a29e-a9dadc53c26f req-4896480b-12e3-4d79-8d25-1cb62766cd7d service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1007.468531] env[65353]: INFO networking_nsxv3.common.synchronization [req-33848949-ad25-47ef-a29e-a9dadc53c26f req-4896480b-12e3-4d79-8d25-1cb62766cd7d service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1007.468648] env[65353]: INFO networking_nsxv3.common.synchronization [req-33848949-ad25-47ef-a29e-a9dadc53c26f req-4896480b-12e3-4d79-8d25-1cb62766cd7d service nova] Enqueued Resource ID: 60781a2e-372f-4466-a612-ab0c21fb5805 with Priority: HIGHEST for action port [ 1007.469203] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1007.469343] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1007.469439] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60781a2e-372f-4466-a612-ab0c21fb5805 with Priority: HIGHEST for action port [ 1007.471049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.471213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.471284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.471476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.471573] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.472600] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.472600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.472753] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-60781a2e-372f-4466-a612-ab0c21fb5805 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.472860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.473061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.473188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.473188] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60781a2e-372f-4466-a612-ab0c21fb5805',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.482437] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1007.482941] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff deletion is rescheduled due to dependency. [ 1007.482941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.975207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.975619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.975709] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60781a2e-372f-4466-a612-ab0c21fb5805 with status ACTIVE [ 1007.975866] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.975950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.976079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.976569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.976569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.976569] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.976729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.976729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.976933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.976995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.977155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.977250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.977306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.977466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.977520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.977596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60781a2e-372f-4466-a612-ab0c21fb5805 is going to be updated. [ 1008.001063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.001178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.001245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.001483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.001616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.001783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60781a2e-372f-4466-a612-ab0c21fb5805" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.006741] env[65353]: INFO networking_nsxv3.common.synchronization [req-5276683f-ba5e-42f8-a7da-6b1e8b539a66 req-d45b68a6-960e-4cf6-88fa-a809762700fa tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1008.008154] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1008.008154] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.008154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.008154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.008388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.008462] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.008585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.008628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.008773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.008851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.008943] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.033264] env[65353]: INFO networking_nsxv3.common.synchronization [req-5276683f-ba5e-42f8-a7da-6b1e8b539a66 req-d45b68a6-960e-4cf6-88fa-a809762700fa tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 1008.033671] env[65353]: INFO networking_nsxv3.common.synchronization [req-5276683f-ba5e-42f8-a7da-6b1e8b539a66 req-d45b68a6-960e-4cf6-88fa-a809762700fa tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1008.033911] env[65353]: INFO networking_nsxv3.common.synchronization [req-5276683f-ba5e-42f8-a7da-6b1e8b539a66 req-d45b68a6-960e-4cf6-88fa-a809762700fa tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 1008.038019] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 1008.038019] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1008.038019] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 1008.038019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.038019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.038019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.038019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.038019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.038019] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4a99e5-0c73-460b-a9c6-88bd9a4554e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.250115] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1008.250313] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1008.250313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.250439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.250661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.250843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.250965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.251035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.251199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.251277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.251370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.498953] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: SUCCESS [ 1008.499302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.499302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.499558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.499751] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.499870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.499953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.500105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.500214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.500255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.500345] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.511331] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.540471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.540742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.541969] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with status ACTIVE [ 1008.542180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.542306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.542394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.542612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.542702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.542871] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.542961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.543038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.543180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.543255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.543469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.543541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.543591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.543706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.543758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.543874] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 is going to be updated. [ 1008.567359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.567557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.567629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.567871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.568118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.568322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.753849] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.002361] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.013352] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.256376] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.505816] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56622075-2f39-4c3e-86af-b1c6fc510beb: rpc.has_security_group_logging(os_id): False [ 1009.515666] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.515831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.515903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.516156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.516280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.516348] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be updated. [ 1009.534977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.534977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.534977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.535294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.535294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.535386] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.535455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.535568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.535719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.535719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.535823] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb is going to be created. [ 1009.575122] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.575297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.575340] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.575763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.575950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.588538] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 2s [ 1009.633809] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.634056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.634326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.634488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.634797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.655255] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: IN_PROGRESS for 2s [ 1009.758787] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.758970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.759204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.759342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.759463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.759528] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1009.816444] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.817832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.818069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.818415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.818744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.834694] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1011.444261] env[65353]: INFO networking_nsxv3.common.synchronization [req-3b6f0085-938e-49df-be8b-60dd3f6fbc60 req-1cc086ec-963f-48f7-9529-e9181d045d37 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1011.444847] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1011.445432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.445432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.468462] env[65353]: INFO networking_nsxv3.common.synchronization [req-3b6f0085-938e-49df-be8b-60dd3f6fbc60 req-1cc086ec-963f-48f7-9529-e9181d045d37 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 1011.468462] env[65353]: INFO networking_nsxv3.common.synchronization [req-3b6f0085-938e-49df-be8b-60dd3f6fbc60 req-1cc086ec-963f-48f7-9529-e9181d045d37 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1011.468636] env[65353]: INFO networking_nsxv3.common.synchronization [req-3b6f0085-938e-49df-be8b-60dd3f6fbc60 req-1cc086ec-963f-48f7-9529-e9181d045d37 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 1011.469153] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_rules [ 1011.469344] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1011.469927] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with Priority: HIGHEST for action port [ 1011.470214] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.470558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.470757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.470852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.471100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.472286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.472286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.472286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.472286] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4a99e5-0c73-460b-a9c6-88bd9a4554e0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.599536] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 1011.599786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.599987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.600220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.600419] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.600580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.600661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.600837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.600921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.601029] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.671120] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: SUCCESS [ 1011.672361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.749343] env[65353]: INFO networking_nsxv3.common.synchronization [req-b10ccd87-dcca-4b6f-a1d9-db35edfb5a01 req-52c21a9a-7219-4d7d-9715-0cbcec94e6e7 tempest-ServersAdminNegativeTestJSON-2083378065 tempest-ServersAdminNegativeTestJSON-2083378065-project-member] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 1011.749949] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 1011.751442] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.751575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.751649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.751874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.752044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.752144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.752210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.752390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.752488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.752597] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.860932] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1011.861192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.861361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.861783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.861783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.861902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.861937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.862080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.862152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.862237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.862326] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.974865] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 with status ACTIVE [ 1011.975268] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.975471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.975586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.975815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.976031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.976149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.976210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.976246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.976778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.976778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.976778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.976778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.976778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.976971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.977029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.977106] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4a99e5-0c73-460b-a9c6-88bd9a4554e0 is going to be updated. [ 1012.006861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.007081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.007153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.007419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.007571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.007785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4a99e5-0c73-460b-a9c6-88bd9a4554e0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.103580] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.254269] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.365224] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.365455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.365541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.365795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.365993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.366144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.366235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.366429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.369597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.369597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.369597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.369597] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.606532] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.756371] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.870564] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 1012.892489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.895024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.895024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.895024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.895768] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.895768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.895768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.895768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.897158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.897299] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1012.969300] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.970036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.970036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.987920] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1013.109247] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.109641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.109756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.110030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.110585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.110754] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be updated. [ 1013.144709] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.144709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.144709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.144974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.145016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.159059] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 2s [ 1013.259360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.259519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.259519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.259724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.259817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.259949] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be updated. [ 1013.291210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.291367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.291483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.291654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.291811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.302087] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 1015.004971] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1015.005286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.170633] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 1015.170908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.171074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.171326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.171553] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.171681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.171749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.171915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.171996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.172098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.172193] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.173750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.173948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.174138] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.174254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.174294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.174443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.174542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.174638] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.313338] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 1015.313338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.394814] env[65353]: INFO networking_nsxv3.common.synchronization [req-52630e5a-88c8-45e3-8c2e-df4a7e9607e1 req-3b269634-3f6f-4f78-b090-a89cdafb9295 tempest-AttachInterfacesUnderV243Test-1489680242 tempest-AttachInterfacesUnderV243Test-1489680242-project-member] Enqueued Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1015.395485] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae with Priority: HIGHEST for action security_group_members [ 1015.396233] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.396233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.609276] env[65353]: INFO networking_nsxv3.common.synchronization [req-a3dfbc89-1c4c-44ec-8dac-01ec69912d7f req-ae5c490a-53f1-4459-bb4f-b28dd05cff6c tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1015.612304] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1015.612304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.612304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.612304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.612304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.612304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.612304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.612715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.612715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.612715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.612802] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.677061] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.678299] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.036503] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.036836] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.036836] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.037155] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.038617] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.038617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.038617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.038617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.038617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.038617] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.038617] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.038617] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.038617] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.038617] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.039132] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.039132] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.062662] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.062833] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.062971] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.063167] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.063482] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-a6049403-4fb3-413e-92b8-cae643a30b56 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.063646] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.063763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.064116] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.064260] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6049403-4fb3-413e-92b8-cae643a30b56',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.115870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.116164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.116164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.116321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.116813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.116813] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.116813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.116813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.117096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.117096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.117096] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a already deleted. [ 1016.117338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.180795] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.181735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb2e509b-93a9-4dd4-864d-59f2d21a37ae: rpc.has_security_group_logging(os_id): False [ 1016.201513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.201701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.201701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.201903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.201988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.202255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.202351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.202428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.202607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.202675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.202777] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be updated. [ 1016.275832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.275960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.276076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.276272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.276423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.291931] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 2s [ 1016.569065] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.569276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.569324] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.569670] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.570656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.570656] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port a6049403-4fb3-413e-92b8-cae643a30b56 not found, creating... [ 1016.570656] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.570656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.570656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.570933] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.570933] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.571498] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.572233] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.572525] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.572815] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.572963] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.573323] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: a6049403-4fb3-413e-92b8-cae643a30b56 is going to be created. [ 1016.596480] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.596693] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.596739] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.597064] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.597323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.597584] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.684798] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.685038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.685038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.685366] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.685491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.685669] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be updated. [ 1016.731853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.732136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.732453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.732638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.732885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.744910] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 2s [ 1017.319736] env[65353]: INFO networking_nsxv3.common.synchronization [req-a3dfbc89-1c4c-44ec-8dac-01ec69912d7f req-68443f14-cd59-41bd-9cb1-d99d8c03ce86 service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1017.319736] env[65353]: INFO networking_nsxv3.common.synchronization [req-a3dfbc89-1c4c-44ec-8dac-01ec69912d7f req-68443f14-cd59-41bd-9cb1-d99d8c03ce86 service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1017.319736] env[65353]: INFO networking_nsxv3.common.synchronization [req-a3dfbc89-1c4c-44ec-8dac-01ec69912d7f req-68443f14-cd59-41bd-9cb1-d99d8c03ce86 service nova] Enqueued Resource ID: a6049403-4fb3-413e-92b8-cae643a30b56 with Priority: HIGHEST for action port [ 1017.320450] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1017.320597] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1017.320693] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6049403-4fb3-413e-92b8-cae643a30b56 with Priority: HIGHEST for action port [ 1017.320976] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.321100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.321168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.321368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.321446] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.322305] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.322410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.322468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.322663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.322807] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.322974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.322974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.323096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.323159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.324838] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.324838] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6049403-4fb3-413e-92b8-cae643a30b56 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.324838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.324838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.324838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.324838] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6049403-4fb3-413e-92b8-cae643a30b56',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.826103] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.826265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.826453] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.827375] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6049403-4fb3-413e-92b8-cae643a30b56 with status ACTIVE [ 1017.827584] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.828220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.828220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.828220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.828220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.828220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.828556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.828556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.828556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.828699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.828776] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.828867] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.828937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.829109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.829163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.829239] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6049403-4fb3-413e-92b8-cae643a30b56 is going to be updated. [ 1017.857740] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.857945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.857945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.858181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.858327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.858508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6049403-4fb3-413e-92b8-cae643a30b56" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.309645] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 1018.310293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.310583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.310875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.310980] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.331212] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.756184] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: IN_PROGRESS for 4s [ 1018.835947] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.835947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.835947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.835947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.835947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.835947] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be created. [ 1018.857102] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.857102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.857102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.857102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.857102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.857102] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be deleted. [ 1018.872723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.875168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.875168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.875168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.875168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.885744] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: UNINITIALIZED for 2s [ 1018.935471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.935471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.935471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.938234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.938234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.938234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.403460] env[65353]: INFO networking_nsxv3.common.synchronization [None req-7406f9c4-9b50-44b6-804b-2c7cbdada0b4 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1019.403771] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1019.404123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.404249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.404315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.404625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.404714] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.498138] env[65353]: INFO networking_nsxv3.common.synchronization [None req-04dad913-a24e-4ca3-8ad5-3fe6aac58c63 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1019.498701] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1019.498976] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.499086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.928500] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.928720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.928792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.929099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.929219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.929219] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 already deleted. [ 1019.929334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.929459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.929626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.929734] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.306223] env[65353]: INFO networking_nsxv3.common.synchronization [req-2085b3c1-dc44-4259-8d63-4eb4cedde943 req-65ac83f8-df20-48b8-ab99-43f01da2c53e tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1020.306223] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1020.306223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.306223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.306223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.306223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.306223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.306223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.306223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.306959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.308469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.308469] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.450697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.450987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.451074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.451315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.451422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.451524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 already deleted. [ 1020.451579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.684327] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.684327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.684823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.684823] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.684979] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.685267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.685552] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.685821] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.685982] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.686607] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.686607] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.686607] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.686607] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.686607] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.688633] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.688633] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.710526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.710777] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.710891] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.711076] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.711400] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-0e125936-c4e1-4ebd-91b3-c642dc00b647 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.714027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.714027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.714027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.714027] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e125936-c4e1-4ebd-91b3-c642dc00b647',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.767667] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae in Status: SUCCESS [ 1020.767667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.767667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.767904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.768105] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.768228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.768295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.768448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.768529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.768622] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.809673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.810848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.810848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.810848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.810848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.810848] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.811424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.811424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.811424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.811424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.811568] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1020.857769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.858159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.858257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.858521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.858697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.870209] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1020.895042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1020.895285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.895491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.895743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.895963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.896105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.896188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.896410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.896488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.896569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.896708] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.215765] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.215765] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.215765] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.215765] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.215765] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.215765] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 0e125936-c4e1-4ebd-91b3-c642dc00b647 not found, creating... [ 1021.215765] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.217321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.217321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.217321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.217479] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.217908] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.218038] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.218134] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.219271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.219271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.219271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 0e125936-c4e1-4ebd-91b3-c642dc00b647 is going to be created. [ 1021.239669] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.239828] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.240936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.240936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.240936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.240936] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.271544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.271635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.271676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.274214] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.274214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.274214] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae is going to be deleted. [ 1021.312065] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.312292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.312292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.312524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.312614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.312713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.312877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.313049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.313220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.313319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.313381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.313557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.313614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.313685] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb2e509b-93a9-4dd4-864d-59f2d21a37ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.398687] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.820232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.820669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.820669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.821756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.821857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.823324] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.823514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.823568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.823823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.823938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.824077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb2e509b-93a9-4dd4-864d-59f2d21a37ae already deleted. [ 1021.824179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb2e509b-93a9-4dd4-864d-59f2d21a37ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.903044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a: rpc.has_security_group_logging(os_id): False [ 1021.924587] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.924826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.924826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.925076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.925171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.925424] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.925531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.925587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.925749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.925828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.925915] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be created. [ 1022.037297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.037450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.037514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.039229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.039445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.057552] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1022.072673] env[65353]: INFO networking_nsxv3.common.synchronization [req-2085b3c1-dc44-4259-8d63-4eb4cedde943 req-182ce7ac-95e7-4fb9-b5af-eafe823b30f5 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1022.072947] env[65353]: INFO networking_nsxv3.common.synchronization [req-2085b3c1-dc44-4259-8d63-4eb4cedde943 req-182ce7ac-95e7-4fb9-b5af-eafe823b30f5 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1022.073096] env[65353]: INFO networking_nsxv3.common.synchronization [req-2085b3c1-dc44-4259-8d63-4eb4cedde943 req-182ce7ac-95e7-4fb9-b5af-eafe823b30f5 service nova] Enqueued Resource ID: 0e125936-c4e1-4ebd-91b3-c642dc00b647 with Priority: HIGHEST for action port [ 1022.073741] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1022.073912] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1022.074037] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e125936-c4e1-4ebd-91b3-c642dc00b647 with Priority: HIGHEST for action port [ 1022.074389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.074557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.074664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.074892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.075105] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.075972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.076115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.077155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e125936-c4e1-4ebd-91b3-c642dc00b647 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.077155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.077155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.077155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.077155] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e125936-c4e1-4ebd-91b3-c642dc00b647',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.579649] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.579649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.579649] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e125936-c4e1-4ebd-91b3-c642dc00b647 with status ACTIVE [ 1022.579891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.579957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.580020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.580261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.580381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.580550] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.580665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.580738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.580914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.581038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.581236] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.581322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.581427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.582158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.582158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.582158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e125936-c4e1-4ebd-91b3-c642dc00b647 is going to be updated. [ 1022.613925] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.614300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.614300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.614591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.614787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e125936-c4e1-4ebd-91b3-c642dc00b647" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.887906] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1022.887906] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1022.887906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.887906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.888386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.888386] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.888542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.888628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.888809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.888900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.890645] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.895699] env[65353]: INFO networking_nsxv3.common.synchronization [req-96732329-2272-4830-a099-c40ee9fcc1b4 req-7f5b6317-cb97-4aea-9c85-4d480141309f tempest-InstanceActionsV221TestJSON-1105607668 tempest-InstanceActionsV221TestJSON-1105607668-project-member] Enqueued Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1022.897078] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1022.897078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.897078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.897078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.898772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.900036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.900648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.901022] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.903049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.903049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.903049] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.394403] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.406036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.408930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.408930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.409750] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a already deleted. [ 1023.410319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.514132] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.514132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-300" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.514132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-300" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.514132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-300" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.514951] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.515338] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.515573] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.516229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.516506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.516886] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.517143] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.517363] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.517586] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.517852] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.519018] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.519018] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.541660] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.541660] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.541660] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.541660] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-300" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.541975] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-53467aff-18ed-49bc-b3d2-5027b1c5fd99 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.541975] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.542130] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.542398] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.542526] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53467aff-18ed-49bc-b3d2-5027b1c5fd99',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.896233] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.050510] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.051336] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.051336] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.051605] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.051892] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.052155] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 53467aff-18ed-49bc-b3d2-5027b1c5fd99 not found, creating... [ 1024.052668] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.052922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.053156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.053429] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.053577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.054157] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.054271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.054493] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.054960] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.055178] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.055377] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 53467aff-18ed-49bc-b3d2-5027b1c5fd99 is going to be created. [ 1024.077109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1024.077109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.083462] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.083727] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.083819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.085037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.085037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.085037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.398527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.398778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.398778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.399081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.399237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.399385] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1024.433665] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.433874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.433923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.434124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.434276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.444640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1024.819032] env[65353]: INFO networking_nsxv3.common.synchronization [req-96732329-2272-4830-a099-c40ee9fcc1b4 req-34dc0fc5-64d3-4148-af92-fb68db5b5d8a service nova] Enqueued Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_rules [ 1024.819032] env[65353]: INFO networking_nsxv3.common.synchronization [req-96732329-2272-4830-a099-c40ee9fcc1b4 req-34dc0fc5-64d3-4148-af92-fb68db5b5d8a service nova] Enqueued Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1024.819773] env[65353]: INFO networking_nsxv3.common.synchronization [req-96732329-2272-4830-a099-c40ee9fcc1b4 req-34dc0fc5-64d3-4148-af92-fb68db5b5d8a service nova] Enqueued Resource ID: 53467aff-18ed-49bc-b3d2-5027b1c5fd99 with Priority: HIGHEST for action port [ 1024.820079] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_rules [ 1024.821195] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1024.821195] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53467aff-18ed-49bc-b3d2-5027b1c5fd99 with Priority: HIGHEST for action port [ 1024.821195] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.821195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.821195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.821911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.821911] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.822717] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.824166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.824166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.824166] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.825834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-53467aff-18ed-49bc-b3d2-5027b1c5fd99 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.825834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.825834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.828190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.828190] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53467aff-18ed-49bc-b3d2-5027b1c5fd99',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.330807] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.331239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.331347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.331455] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53467aff-18ed-49bc-b3d2-5027b1c5fd99 with status ACTIVE [ 1025.331607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.331815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.332064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.332118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.332214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.332553] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.332693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.332820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.333030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.333164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.333375] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.333447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.333447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.333607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.333686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.333813] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53467aff-18ed-49bc-b3d2-5027b1c5fd99 is going to be updated. [ 1025.364137] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.364137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.364137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.364137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.364137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.364137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53467aff-18ed-49bc-b3d2-5027b1c5fd99" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.836525] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.340504] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.340917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.340917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.340917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.341080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.341114] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a is going to be created. [ 1026.369483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.369738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.369808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.370067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.370344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.383406] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: UNINITIALIZED for 2s [ 1026.458323] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.458323] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.458323] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.458323] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.961140] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.961357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.961357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.962114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.962114] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.962114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.962114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.962114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.962446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.962446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.962535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.963922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.963922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.963922] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.467641] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 1027.491068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.491068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.491068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.491068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.491785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.492065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.492462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.496529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.496529] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.496529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.496529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.496529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.496529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.496529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1027.568024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.568328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.568328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.568463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.568579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.585305] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1028.397912] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: SUCCESS [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.397912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.397912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.399294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.399659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.400512] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.497164] env[65353]: INFO networking_nsxv3.common.synchronization [None req-475387eb-1049-451b-92b9-96a8822af036 None None] Enqueued Resource ID: a995f8ea-5504-4431-b0af-0485d252d477 with Priority: HIGHEST for action port [ 1028.497164] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a995f8ea-5504-4431-b0af-0485d252d477 with Priority: HIGHEST for action port [ 1028.497164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a995f8ea-5504-4431-b0af-0485d252d477 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.497164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a995f8ea-5504-4431-b0af-0485d252d477" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.497164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a995f8ea-5504-4431-b0af-0485d252d477" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.497164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a995f8ea-5504-4431-b0af-0485d252d477" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.497164] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a995f8ea-5504-4431-b0af-0485d252d477',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.508475] env[65353]: INFO networking_nsxv3.common.synchronization [req-e424415d-daf6-4557-b8d5-9b7918884c6b req-b5a37a2f-4c2f-4ef0-8420-8784b2a232f1 tempest-ServersAdminNegativeTestJSON-2083378065 tempest-ServersAdminNegativeTestJSON-2083378065-project-member] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 1028.508801] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGHEST for action security_group_members [ 1028.509616] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.509616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.509616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.509616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.509828] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.509828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.509923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.510151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.510151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.510252] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.904544] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.904798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.904846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.905128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.905350] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.905453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.905515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.905703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.905786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.905879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.906075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.906226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.906226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.906385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.906503] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.906624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.906669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.906835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.906879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.906976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.907089] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.002185] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a995f8ea-5504-4431-b0af-0485d252d477 [ 1029.004609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.004779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.004838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.005033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.005144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.005278] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a995f8ea-5504-4431-b0af-0485d252d477 already deleted. [ 1029.005361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a995f8ea-5504-4431-b0af-0485d252d477" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.011970] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.012138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.012214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.012440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.012522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.012708] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.012827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.012883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.013046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.013126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.013251] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be updated. [ 1029.043631] env[65353]: INFO networking_nsxv3.common.synchronization [req-793efef3-8f06-408e-bc03-2a8a3bb7bbc8 req-8a8de890-1515-42fe-9b80-38f331dd2db8 tempest-ServersTestBootFromVolume-150012720 tempest-ServersTestBootFromVolume-150012720-project-member] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 1029.043631] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGHEST for action security_group_members [ 1029.044387] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.044387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.044558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.044870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.045404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.045574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.045776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.045993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.046137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.046250] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.050924] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.051246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.051246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.051356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.051499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.066501] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: IN_PROGRESS for 2s [ 1029.413109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff847f4a-e188-46a1-bbea-b7ce5960a51a: rpc.has_security_group_logging(os_id): False [ 1029.434988] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.434988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.435411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.435701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.435837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.436209] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.436341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.436411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.436654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.437931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.440487] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.440487] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.440487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.440487] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a is going to be created. [ 1029.506188] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.506188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.506188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.506803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.506803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.523486] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: IN_PROGRESS for 2s [ 1029.555116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.559274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.559388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.559813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.559813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.560017] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.560145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.560216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.560384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.560490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.560601] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 is going to be updated. [ 1029.604312] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.604558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.604558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.604750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.604906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.618271] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: IN_PROGRESS for 2s [ 1029.619211] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1029.619454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.776303] env[65353]: INFO networking_nsxv3.common.synchronization [None req-2ca3d2e2-4465-4847-b41e-e0b345e5ca09 tempest-ServersTestManualDisk-744346416 tempest-ServersTestManualDisk-744346416-project-member] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1029.776929] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1029.778778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.778913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.778913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.779169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.779557] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.175508] env[65353]: INFO networking_nsxv3.common.synchronization [req-c37839f2-e2fd-4ba6-ad28-68d5b43b024e req-87c65517-ef99-4293-b108-e64a9865715c tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1030.176149] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1030.176845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.176845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.176845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.177164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.177250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.177308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.177549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.177644] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.199617] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1030.199753] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1030.315276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.315436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.315436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.315730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.315835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.315934] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 already deleted. [ 1030.316545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.398280] env[65353]: INFO networking_nsxv3.common.synchronization [None req-20c9e188-1045-4e78-a9ef-22b6d21aa069 tempest-ServersTestManualDisk-744346416 tempest-ServersTestManualDisk-744346416-project-member] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1030.398924] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1030.401429] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.401429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.401429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.401429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.401429] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.680071] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.680339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.680420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.680995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.680995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.680995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.680995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.681255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.681255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.681319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.681418] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 already deleted. [ 1030.681457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.685495] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.686684] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.686684] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.686684] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.686684] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.686921] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.686921] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.687100] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.687268] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.687869] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.687869] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.687869] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.687869] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.688099] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.688141] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.688265] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.709707] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.709892] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.710021] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.710206] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.710540] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.711035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.711035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.711351] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.711464] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3d8e5e-3f83-41a3-9d1c-5316256e2333',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.930202] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.930202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.930202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.930202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.930202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.930202] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 already deleted. [ 1030.930202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.081314] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 in Status: SUCCESS [ 1031.081314] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 deletion is rescheduled due to dependency. [ 1031.081314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.213775] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.214044] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.214112] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.214356] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.214508] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.214698] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 not found, creating... [ 1031.215042] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.215223] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.215341] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.215560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.215890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.216327] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.216530] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.216696] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.217074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.217357] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.217510] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 is going to be created. [ 1031.240875] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.241023] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.241060] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.241352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.241635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.241907] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.538485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: SUCCESS [ 1031.538951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.629097] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 in Status: SUCCESS [ 1031.629312] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 deletion is rescheduled due to dependency. [ 1031.629418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.003409] env[65353]: INFO networking_nsxv3.common.synchronization [None req-490d87e6-fd94-4a1f-a714-d3020c650e8e None None] Enqueued Resource ID: 12a67108-543a-4709-9b93-1281e4b34678 with Priority: HIGHEST for action port [ 1032.003949] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a67108-543a-4709-9b93-1281e4b34678 with Priority: HIGHEST for action port [ 1032.004364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a67108-543a-4709-9b93-1281e4b34678 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.004492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a67108-543a-4709-9b93-1281e4b34678" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.004492] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a67108-543a-4709-9b93-1281e4b34678" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.004797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a67108-543a-4709-9b93-1281e4b34678" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.004877] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a67108-543a-4709-9b93-1281e4b34678',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.061378] env[65353]: INFO networking_nsxv3.common.synchronization [req-c37839f2-e2fd-4ba6-ad28-68d5b43b024e req-d9f7b448-7308-4c25-b431-d64ae5849a9d service nova] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1032.061378] env[65353]: INFO networking_nsxv3.common.synchronization [req-c37839f2-e2fd-4ba6-ad28-68d5b43b024e req-d9f7b448-7308-4c25-b431-d64ae5849a9d service nova] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1032.061378] env[65353]: INFO networking_nsxv3.common.synchronization [req-c37839f2-e2fd-4ba6-ad28-68d5b43b024e req-d9f7b448-7308-4c25-b431-d64ae5849a9d service nova] Enqueued Resource ID: 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 with Priority: HIGHEST for action port [ 1032.061818] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1032.061818] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1032.061892] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 with Priority: HIGHEST for action port [ 1032.062587] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.062726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.062797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.063496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.063496] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.066875] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.066875] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.066875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.066875] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.068146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.068146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.068146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.068146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.068146] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3d8e5e-3f83-41a3-9d1c-5316256e2333',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.507758] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a67108-543a-4709-9b93-1281e4b34678 [ 1032.507996] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.508150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.508212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.508475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.508523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.508615] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a67108-543a-4709-9b93-1281e4b34678 already deleted. [ 1032.508715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a67108-543a-4709-9b93-1281e4b34678" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.569587] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.570696] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.570886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.571131] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 with status ACTIVE [ 1032.571194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.571295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.571341] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.572923] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.572923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.572923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.572923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.572923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.573386] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.573386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.573386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.573386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.573977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.573977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a3d8e5e-3f83-41a3-9d1c-5316256e2333 is going to be updated. [ 1032.601288] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.601382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.601469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.601628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.601765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.601928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a3d8e5e-3f83-41a3-9d1c-5316256e2333" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.076144] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.173354] env[65353]: INFO networking_nsxv3.common.synchronization [req-9dbd1e92-7c18-4045-9ece-ee0532e700b4 req-a4f53a7a-0fba-4144-958c-2fbc1e85b2fc tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1033.173928] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1033.174277] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.174406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.174479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.174667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.177200] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.177353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.177427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.177624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.177712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.177828] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.579607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.579820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.579889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.580173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.580274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.580383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be created. [ 1033.609756] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.609756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.609756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.609756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.609756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.620607] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: UNINITIALIZED for 2s [ 1033.680176] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.680332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.680422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.680771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.680771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.680945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.681134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.681193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.681351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.681429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.681588] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1033.685743] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.685944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.686090] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.686347] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.686595] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.686746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.686860] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.687096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.687238] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.687564] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.687726] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.687842] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.687951] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.688076] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.688186] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.688314] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.710185] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.710360] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.710497] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.710658] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.710962] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-87acc1a3-b448-4fce-9e52-e44064d2791a taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.711141] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.711257] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.711606] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.711756] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87acc1a3-b448-4fce-9e52-e44064d2791a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.713378] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.713494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.713559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.715430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.715430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.724015] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1034.216132] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.216517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.216517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.216756] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.216906] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.217141] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 87acc1a3-b448-4fce-9e52-e44064d2791a not found, creating... [ 1034.217424] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.217595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.217713] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.217931] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.218080] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.218361] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.218533] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.218659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.218862] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.218991] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.220530] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 87acc1a3-b448-4fce-9e52-e44064d2791a is going to be created. [ 1034.242830] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.243055] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.243609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.243609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.243762] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.243922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.513672] env[65353]: INFO networking_nsxv3.common.synchronization [None req-acecdc1a-c4cb-43d3-9a9a-ce17c5e75120 None None] Enqueued Resource ID: f1869a13-3d83-4adb-af29-43c5fe9143d4 with Priority: HIGHEST for action port [ 1034.514224] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1869a13-3d83-4adb-af29-43c5fe9143d4 with Priority: HIGHEST for action port [ 1034.514535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1869a13-3d83-4adb-af29-43c5fe9143d4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.514735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1869a13-3d83-4adb-af29-43c5fe9143d4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.514831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1869a13-3d83-4adb-af29-43c5fe9143d4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.515117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1869a13-3d83-4adb-af29-43c5fe9143d4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.515209] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1869a13-3d83-4adb-af29-43c5fe9143d4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.981284] env[65353]: INFO networking_nsxv3.common.synchronization [req-9dbd1e92-7c18-4045-9ece-ee0532e700b4 req-a843d3f8-e0b9-43d7-8d3e-cc39a8886d26 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1034.981284] env[65353]: INFO networking_nsxv3.common.synchronization [req-9dbd1e92-7c18-4045-9ece-ee0532e700b4 req-a843d3f8-e0b9-43d7-8d3e-cc39a8886d26 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1034.981445] env[65353]: INFO networking_nsxv3.common.synchronization [req-9dbd1e92-7c18-4045-9ece-ee0532e700b4 req-a843d3f8-e0b9-43d7-8d3e-cc39a8886d26 service nova] Enqueued Resource ID: 87acc1a3-b448-4fce-9e52-e44064d2791a with Priority: HIGHEST for action port [ 1034.981870] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1034.982009] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1034.982565] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87acc1a3-b448-4fce-9e52-e44064d2791a with Priority: HIGHEST for action port [ 1034.983338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.983338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.983338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.983603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.983603] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.985533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.985791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.986043] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-87acc1a3-b448-4fce-9e52-e44064d2791a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.986159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.986225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.986423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.986501] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87acc1a3-b448-4fce-9e52-e44064d2791a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.016793] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1869a13-3d83-4adb-af29-43c5fe9143d4 [ 1035.017112] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.017291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.017342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.017526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.017665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.017724] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1869a13-3d83-4adb-af29-43c5fe9143d4 already deleted. [ 1035.017822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1869a13-3d83-4adb-af29-43c5fe9143d4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.122028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.122028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.122028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.122251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.122331] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.489852] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.489852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.493159] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87acc1a3-b448-4fce-9e52-e44064d2791a with status ACTIVE [ 1035.493423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.493556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.493621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.493847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.493920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.494164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.494302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.494365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.494521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.494679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.494976] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.495172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.495258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.495471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.495581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.495765] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87acc1a3-b448-4fce-9e52-e44064d2791a is going to be updated. [ 1035.518481] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.518481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.518481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.518481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.518481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.518753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87acc1a3-b448-4fce-9e52-e44064d2791a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.624235] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.630294] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1035.630657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.630726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.630888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.631089] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.631672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.631672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.631672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.631672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.631672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.631672] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.737490] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1035.737490] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff deletion is rescheduled due to dependency. [ 1035.737490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.738035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.738195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.738430] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.738585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.739062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.739062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.739062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.739309] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.128479] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.135578] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.241990] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.631356] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1036.631673] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1036.638184] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9614eb5-4fb3-4d03-8d1c-b9427ffd4934: rpc.has_security_group_logging(os_id): False [ 1036.659254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.659932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.660046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.660255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.660342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.660912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.660912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.660912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.660912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.661200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.661200] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be created. [ 1036.734889] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.735172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.735172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.735298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.735475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.745770] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.750426] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1036.976510] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ce69110e-884e-4c8e-8171-3a05b835d12d None None] Enqueued Resource ID: 07442769-ee75-44db-8fa3-85a1cdae3b9b with Priority: HIGHEST for action port [ 1036.977235] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07442769-ee75-44db-8fa3-85a1cdae3b9b with Priority: HIGHEST for action port [ 1036.977628] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-07442769-ee75-44db-8fa3-85a1cdae3b9b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.977628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07442769-ee75-44db-8fa3-85a1cdae3b9b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.977628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07442769-ee75-44db-8fa3-85a1cdae3b9b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.978303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07442769-ee75-44db-8fa3-85a1cdae3b9b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.978382] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07442769-ee75-44db-8fa3-85a1cdae3b9b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.248066] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.249310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.249462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.250038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.250038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.250038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1037.291870] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.291870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.291870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.291870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.291870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.302204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1037.484425] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07442769-ee75-44db-8fa3-85a1cdae3b9b [ 1037.484425] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.484425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.484425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.484882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.484920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.485089] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07442769-ee75-44db-8fa3-85a1cdae3b9b already deleted. [ 1037.487664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07442769-ee75-44db-8fa3-85a1cdae3b9b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.676750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.676750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.676750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.677304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.693671] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1037.694627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.696323] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1037.741117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.741117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.741117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.741117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.754276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.755070] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1037.755179] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.755254] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1037.826569] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.826721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.827946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.828123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.830613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.831081] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1037.927834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.927834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.927834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.927834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.928879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.929200] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1038.020622] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.020622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.020770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.020906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.021187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.021461] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1038.021585] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ee283bce-4b1f-47a4-b9bc-1f0367034344', '1ebabbee-f94a-4795-9ff8-41a9c6c02592', '3ff9462c-b088-43b8-bce6-23c663c231c4', '77899b4e-41ba-45bf-ac89-22e780314f5f', 'a9e4cc2e-7db9-4ecb-adb0-1ff58af51797', '752918e1-1064-471b-80a5-ab7d9c9b7427', '8b5a0023-7c40-4513-bccf-974952e7a64c', 'a28dd6d0-e311-4f5d-a6ed-59453af2dcc0', '97a6a2db-7d02-4b39-8d52-74d0e645bfea', '0b59c8a2-e271-42d7-9144-e62c90117e8b', '6201df91-3340-45fd-8fb5-eb672e417941', '8d5e265c-8dcf-4ba9-992c-3e96278d6735', 'e97e4458-7809-406b-8b2f-b7ee556500c1', '5b9cd2d9-7e06-497a-a422-6b045be4a832', '48b0c35b-0d23-4bce-9d0f-06d04bbceb0e', 'f9614eb5-4fb3-4d03-8d1c-b9427ffd4934', '576f0f86-448d-4fa9-9110-1b5ac65e3d65', 'e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6', '069ced97-9b0a-489d-acf5-0da342604329', 'fedc8572-c14a-4402-8307-015f5348ce03', '56622075-2f39-4c3e-86af-b1c6fc510beb', 'da59ee93-ae54-4a16-87c6-1b9e93ee605e', '5171ec2a-8acc-4736-a34b-cf763dc5c9f7', 'c2f635c3-4601-4155-b8e5-e2dab677e518', '1e718fc6-a572-4276-83ab-0e7e530140d0', '66ea3edd-9280-4ba2-b412-ca1c1ac57a2a', 'fcebdf84-f874-4db4-b283-bda9c57166cf', '400ed73f-78cb-4aac-8a3b-e0415f1fbf19', 'b9972817-ff77-432f-a5cd-8388f88bd29a', '357b71ae-4236-49a4-9cb3-5cec4c42e443', 'e8cbd2fb-a386-46ba-9054-c04ccc0a46d9', 'fc6d712f-e111-4ee3-8ed1-729c0a27074b', '3469e958-4a31-4f2a-987e-042bbed3a4ae', '2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff', 'ff847f4a-e188-46a1-bbea-b7ce5960a51a', 'f70850f2-6628-4be4-939e-95e5fadec74b', '4ef686cd-78eb-46c8-a0b8-b56b7873d69d', 'eef90e1f-f512-4c74-82f2-c918b64f5aee', 'dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad', '1a2987c0-489b-45df-9694-cf09b0682b7c', 'cadcc6df-baac-43fd-bf48-5485c0b69d95', '101d7123-33df-4206-98ea-c31321fdee80', 'e0209ced-141c-4ff9-b95c-1f2fc770b1f0', '0bceb08f-d9a1-4677-8b2e-0aeacfbbb531', '187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5', 'e9cb80b2-00dd-48f3-aba0-08eecbed0594'} {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1038.021680] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1038.043055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.043273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.043273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.043496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.043584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.043704] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1038.043773] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1038.043833] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1038.144422] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.144590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.144640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.145484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.145992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.147333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1038.147333] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1038.147333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1038.147333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1038.147333] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1038.147333] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGH for action security_group_rules [ 1038.147580] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGH for action security_group_rules [ 1038.147580] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGH for action security_group_rules [ 1038.147580] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGH for action security_group_rules [ 1038.147580] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 1038.147701] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGH for action security_group_rules [ 1038.147701] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGH for action security_group_rules [ 1038.147762] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGH for action security_group_rules [ 1038.147802] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGH for action security_group_rules [ 1038.147905] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 1038.147950] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGH for action security_group_rules [ 1038.147983] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGH for action security_group_rules [ 1038.148115] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGH for action security_group_rules [ 1038.148115] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGH for action security_group_rules [ 1038.148181] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGH for action security_group_rules [ 1038.148241] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGH for action security_group_rules [ 1038.148389] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGH for action security_group_rules [ 1038.148389] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGH for action security_group_rules [ 1038.148476] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGH for action security_group_rules [ 1038.148508] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGH for action security_group_rules [ 1038.148726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.460314] env[65353]: INFO networking_nsxv3.common.synchronization [req-ae73cb5e-6e16-4fc4-9908-ea4ce2aa757a req-44048973-8f32-48d2-b211-96ad89007a12 tempest-InstanceActionsV221TestJSON-1105607668 tempest-InstanceActionsV221TestJSON-1105607668-project-member] Enqueued Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1038.461287] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGHEST for action security_group_members [ 1038.461437] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGH for action security_group_rules [ 1038.461538] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 with Priority: HIGH for action security_group_rules [ 1038.461638] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5a0023-7c40-4513-bccf-974952e7a64c with Priority: HIGH for action security_group_rules [ 1038.461735] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e with Priority: HIGH for action security_group_rules [ 1038.461828] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc8572-c14a-4402-8307-015f5348ce03 with Priority: HIGH for action security_group_rules [ 1038.461919] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069ced97-9b0a-489d-acf5-0da342604329 with Priority: HIGH for action security_group_rules [ 1038.462018] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 with Priority: HIGH for action security_group_rules [ 1038.462117] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 with Priority: HIGH for action security_group_rules [ 1038.462206] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGH for action security_group_rules [ 1038.462294] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGH for action security_group_rules [ 1038.462381] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97e4458-7809-406b-8b2f-b7ee556500c1 with Priority: HIGH for action security_group_rules [ 1038.462467] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 with Priority: HIGH for action security_group_rules [ 1038.462554] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGH for action security_group_rules [ 1038.462642] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 1038.462727] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea with Priority: HIGH for action security_group_rules [ 1038.462814] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 with Priority: HIGH for action security_group_rules [ 1038.462901] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGH for action security_group_rules [ 1038.462986] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 1038.463085] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 with Priority: HIGH for action security_group_rules [ 1038.463224] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77899b4e-41ba-45bf-ac89-22e780314f5f with Priority: HIGH for action security_group_rules [ 1038.463465] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.463582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.463643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.463844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.463994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.464104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.464161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.464440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.464528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.465043] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.465593] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.465707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.465790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.465983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.466075] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.467878] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ff9462c-b088-43b8-bce6-23c663c231c4 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.468086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.468086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.468287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.468287] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ff9462c-b088-43b8-bce6-23c663c231c4',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.469226] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b5a0023-7c40-4513-bccf-974952e7a64c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.469299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.469533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.469533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.469647] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b5a0023-7c40-4513-bccf-974952e7a64c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.470367] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.470367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.470478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.470684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.471028] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b0c35b-0d23-4bce-9d0f-06d04bbceb0e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.471784] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fedc8572-c14a-4402-8307-015f5348ce03 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.471889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.471954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.472114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.472186] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fedc8572-c14a-4402-8307-015f5348ce03',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.472853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-069ced97-9b0a-489d-acf5-0da342604329 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.472972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.473264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.473490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.474735] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('069ced97-9b0a-489d-acf5-0da342604329',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.475651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.475651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.475777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.475896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.475958] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.477175] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.477298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.477350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.478015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.478110] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('576f0f86-448d-4fa9-9110-1b5ac65e3d65',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.478750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.478857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.478944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.479114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.479188] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.480140] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.480274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.480486] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97e4458-7809-406b-8b2f-b7ee556500c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.480603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.480645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.482426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.482426] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97e4458-7809-406b-8b2f-b7ee556500c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.483723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.483846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.483967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.484198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.484356] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5e265c-8dcf-4ba9-992c-3e96278d6735',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.485308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.487152] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.487152] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.487152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.487152] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.493536] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.493687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.493757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.493891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.493967] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a6a2db-7d02-4b39-8d52-74d0e645bfea',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.495199] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752918e1-1064-471b-80a5-ab7d9c9b7427 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.496110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.496110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.496308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.496401] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752918e1-1064-471b-80a5-ab7d9c9b7427',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.498040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.498040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.498040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.498040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.498040] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.498379] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.498454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.498508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.498638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.498702] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.502406] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.502775] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.502853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.502853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.502853] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ebabbee-f94a-4795-9ff8-41a9c6c02592',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.504729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77899b4e-41ba-45bf-ac89-22e780314f5f taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.504729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.504729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.504729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.504729] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77899b4e-41ba-45bf-ac89-22e780314f5f',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.532153] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.532304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.532375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.533439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.552474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.552619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ff9462c-b088-43b8-bce6-23c663c231c4 is going to be deleted. [ 1038.607765] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.608051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.608160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.608435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.608567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.609015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ff9462c-b088-43b8-bce6-23c663c231c4" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.766579] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1038.766579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.766579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.766579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.766579] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.010357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.010357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.010357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.011508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.012155] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.012522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.012827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.013594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.013949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.014677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.015047] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.021035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.021035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.021035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.021035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.024198] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.024738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.025105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.025623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.026151] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.026487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.026747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.027154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.027436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.027712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.028012] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.038021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.038021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.038021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.038701] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.042910] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046036] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.096401] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.096401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.104327] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.104505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.118518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.118679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.119734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.119863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.126598] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.126767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.128270] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.128464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.131371] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.131611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.132796] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.134377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.135841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.136140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.138718] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.139207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.140394] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.141409] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.141550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.143085] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.143734] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.144003] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.144981] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.145516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.146236] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.146358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.146421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.146865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.146865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.147040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a is going to be updated. [ 1039.148188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.148418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.156876] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.157145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.158274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.158274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.173087] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.173311] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.173434] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be deleted. [ 1039.174463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.175743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.190293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.190772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.190772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.190772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.191223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.200355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.200534] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fedc8572-c14a-4402-8307-015f5348ce03 is going to be deleted. [ 1039.201603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.202038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.205187] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: IN_PROGRESS for 2s [ 1039.234301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.234453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 069ced97-9b0a-489d-acf5-0da342604329 is going to be deleted. [ 1039.235428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.235656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.256517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.256517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.268923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.269100] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6 is going to be deleted. [ 1039.270348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.270524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.270582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.271356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.271356] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.271972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.272091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.272248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.272346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.272442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.272536] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.274955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.275167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.277053] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.277053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.306378] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.306556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.313225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.313225] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 576f0f86-448d-4fa9-9110-1b5ac65e3d65 is going to be deleted. [ 1039.314759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.314759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.319294] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.319294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.319294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.320564] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.371409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.371616] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752918e1-1064-471b-80a5-ab7d9c9b7427 is going to be deleted. [ 1039.372820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.373693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.390510] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.390733] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.418612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.418757] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b5a0023-7c40-4513-bccf-974952e7a64c is going to be deleted. [ 1039.419764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.419974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.425046] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.425046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.467965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.468248] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5e265c-8dcf-4ba9-992c-3e96278d6735 is going to be deleted. [ 1039.469153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.469372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.517796] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.517796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.524846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.527030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97e4458-7809-406b-8b2f-b7ee556500c1 is going to be deleted. [ 1039.527030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.527030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.536038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.536038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.536038] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.536038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.536786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.536786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.536786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536786] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.538639] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.539899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.557799] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.558014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.558096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.558290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.558478] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.558724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.558724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.558864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.558901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.558991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.559434] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.559434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.559434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.559636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.559636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.559758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.559758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.559898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.559980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.560675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.560782] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.561802] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.567069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.567069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.567069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.568438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.568679] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.568802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.568862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.569060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.572763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.572763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.572763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.572763] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.575213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.575337] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ebabbee-f94a-4795-9ff8-41a9c6c02592 is going to be deleted. [ 1039.576829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.577066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.586582] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.586582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.622598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.622789] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77899b4e-41ba-45bf-ac89-22e780314f5f is going to be deleted. [ 1039.624352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.624868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.654638] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.654638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.657918] env[65353]: INFO networking_nsxv3.common.synchronization [req-d5538395-0f16-4f44-8456-bb801071e3a9 req-637ad5c5-1222-43e2-93a5-17c0e6b2752e tempest-ServersTestManualDisk-744346416 tempest-ServersTestManualDisk-744346416-project-member] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1039.658663] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1039.659974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.660167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.660238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.660516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.660754] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.661249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.661331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.661728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.661728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.661728] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.664719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.665077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b0c35b-0d23-4bce-9d0f-06d04bbceb0e is going to be deleted. [ 1039.666357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.666510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.725282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.725492] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a6a2db-7d02-4b39-8d52-74d0e645bfea is going to be deleted. [ 1039.726595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.727543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.775633] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.785967] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.786162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.821979] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.848371] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.848719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.853354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.853354] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be deleted. [ 1039.853689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.853975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.854244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.854687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.858480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.858637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.859275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.859275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fedc8572-c14a-4402-8307-015f5348ce03" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.859561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.859719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.859819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.859921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-069ced97-9b0a-489d-acf5-0da342604329" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.860828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.860828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.861324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.861324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f6d8b9-08bf-47c3-a0c5-e26f16e44fa6" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.861482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.862017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.862017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.862017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-576f0f86-448d-4fa9-9110-1b5ac65e3d65" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.862206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.862879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.862879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.862879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752918e1-1064-471b-80a5-ab7d9c9b7427" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.863658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.863658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.863658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.863824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b5a0023-7c40-4513-bccf-974952e7a64c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5e265c-8dcf-4ba9-992c-3e96278d6735" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.864854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.865213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97e4458-7809-406b-8b2f-b7ee556500c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.865268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.865856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.865856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.865856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ebabbee-f94a-4795-9ff8-41a9c6c02592" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.865856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.866109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.866248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.866697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77899b4e-41ba-45bf-ac89-22e780314f5f" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.895563] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.895818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.895869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.896562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.896562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.896562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b0c35b-0d23-4bce-9d0f-06d04bbceb0e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.991659] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.991829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.992123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.992266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.992364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.992433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a6a2db-7d02-4b39-8d52-74d0e645bfea" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.997512] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.998249] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.998481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.998607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.998940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.999103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.999298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.043097] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28dd6d0-e311-4f5d-a6ed-59453af2dcc0: rpc.has_security_group_logging(os_id): False [ 1040.069926] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 1040.075572] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b59c8a2-e271-42d7-9144-e62c90117e8b: rpc.has_security_group_logging(os_id): False [ 1040.075572] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e4cc2e-7db9-4ecb-adb0-1ff58af51797: rpc.has_security_group_logging(os_id): False [ 1040.078154] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.078774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.079156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.079631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.126649] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.127129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.127752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.127854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.130100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.130100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.165719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.166071] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.166204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.166272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.166578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.166578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.167050] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.167050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.167050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.167352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.167352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.167464] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.167551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.167551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.167696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.167768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.167860] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 1040.169318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.169389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.170952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.171054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174211] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-604" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-604" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.174872] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-604" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.175166] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.175330] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.175459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.175654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.175854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.176180] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.176234] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.176300] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.176405] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.176504] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.176650] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.176760] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.220439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.220829] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.221023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.221084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.221320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.221438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.221675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.221800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.222042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.222042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.222167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.222306] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.222383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.222443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.222640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.222753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.222860] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1040.223946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.224145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.227067] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.227215] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.227350] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.227523] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-604" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.227874] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-64778d73-4853-4940-8c36-631e6bbe5229 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.228056] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.228178] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.228486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.228619] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64778d73-4853-4940-8c36-631e6bbe5229',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.257453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.259526] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.259734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.260042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.260173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.260339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.260655] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.260815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.260925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.261173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.261310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.261627] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.261773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.261876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.262304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.262427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.262587] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 1040.263801] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.264151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.278821] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9614eb5-4fb3-4d03-8d1c-b9427ffd4934: rpc.has_security_group_logging(os_id): False [ 1040.287983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.288332] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.288452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.288487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.288705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.288792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.288890] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1040.289979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.290185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.290272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.290494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.290607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.290668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.290813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.290887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.290971] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 already deleted. [ 1040.291077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.292968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.292968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.293083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.293193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.293334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.311586] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.311726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.311796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.312000] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.319640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 1040.325332] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff: rpc.has_security_group_logging(os_id): False [ 1040.376891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.377110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.382419] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.382782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.387891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.388586] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.388586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.388586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.388750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.388750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.388829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1040.390855] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.391047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.391149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.391348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.391494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.392563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.392757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.392887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.393887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.394066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.458977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 1040.465147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.465372] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.465586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.465586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.465824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.465935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.466072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1040.468377] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1040.533276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.533276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.533276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.533276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.533276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.571280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.571280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.571280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.571280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.571280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.572082] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1040.601185] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1040.643953] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.646601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.648921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.648921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.648921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.671791] env[65353]: INFO networking_nsxv3.common.synchronization [req-fc567e9d-c9de-4542-8c4d-d87d17408241 req-14f6a516-df9b-4d3f-ba61-2f117c96b809 tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 1040.674908] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGHEST for action security_group_members [ 1040.675378] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.675522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.675569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.675858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.675977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.676088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.676153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.676304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.676435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.676579] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.692082] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1040.731618] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.731926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.732252] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.732380] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.732594] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.732800] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 64778d73-4853-4940-8c36-631e6bbe5229 not found, creating... [ 1040.733133] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.733306] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.733817] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.734249] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.734565] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.735152] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.735410] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.735575] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.736039] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.736294] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.736488] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 64778d73-4853-4940-8c36-631e6bbe5229 is going to be created. [ 1040.777939] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.778541] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.778639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.778991] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.779340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.779643] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.181043] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.181043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.181043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.181043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.201327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.201570] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.201682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.201745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.201939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.202023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.202110] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f70850f2-6628-4be4-939e-95e5fadec74b is going to be updated. [ 1041.215664] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a in Status: SUCCESS [ 1041.215852] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a deletion is rescheduled due to dependency. [ 1041.215973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.230396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.230555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.230642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.230833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.230968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.243079] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: IN_PROGRESS for 2s [ 1041.477637] env[65353]: INFO networking_nsxv3.common.synchronization [req-d5538395-0f16-4f44-8456-bb801071e3a9 req-79708f3f-6e0b-41ec-bc8d-766bb8cdaf80 service nova] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1041.477741] env[65353]: INFO networking_nsxv3.common.synchronization [req-d5538395-0f16-4f44-8456-bb801071e3a9 req-79708f3f-6e0b-41ec-bc8d-766bb8cdaf80 service nova] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1041.477830] env[65353]: INFO networking_nsxv3.common.synchronization [req-d5538395-0f16-4f44-8456-bb801071e3a9 req-79708f3f-6e0b-41ec-bc8d-766bb8cdaf80 service nova] Enqueued Resource ID: 64778d73-4853-4940-8c36-631e6bbe5229 with Priority: HIGHEST for action port [ 1041.478393] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_rules [ 1041.478535] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1041.478618] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64778d73-4853-4940-8c36-631e6bbe5229 with Priority: HIGHEST for action port [ 1041.479099] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.479263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.479355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.479592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.480082] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.480694] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.481508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.481508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.481508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.481508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.481508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.481508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.483113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.483113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.483192] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.484249] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-64778d73-4853-4940-8c36-631e6bbe5229 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.484494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.484624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.485269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.485269] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64778d73-4853-4940-8c36-631e6bbe5229',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.987146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.987146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.987470] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.988738] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64778d73-4853-4940-8c36-631e6bbe5229 with status ACTIVE [ 1041.988738] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.988965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.988965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.989133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.989204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.989369] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.989461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.989526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.989674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.989750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.989921] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.990018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.990186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.990346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.991025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.991025] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64778d73-4853-4940-8c36-631e6bbe5229 is going to be updated. [ 1042.013527] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.013527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.013527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.013527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.013527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.013527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64778d73-4853-4940-8c36-631e6bbe5229" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.016721] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5d6727e-507b-405a-8e25-5a62d82cd1ce req-662b3c0a-5f28-465e-a420-a3ecb43c073d tempest-InstanceActionsTestJSON-648593330 tempest-InstanceActionsTestJSON-648593330-project-member] Enqueued Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1042.017664] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1042.017664] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.017664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.017818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.017934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.018099] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.018214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.018262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.018712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.018712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.018712] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.336468] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 1042.337767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.433200] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.433404] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.433528] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.433802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.434070] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.434229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.434725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.435011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.435291] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.435466] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.435686] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.435916] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.436054] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.436175] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.436282] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.436413] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.460232] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.461017] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.461017] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.461017] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-815" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.461459] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-2e10f1e2-c341-4256-b590-954c1ecabf1c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.461459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.461459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.461817] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.461963] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e10f1e2-c341-4256-b590-954c1ecabf1c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.482324] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 1042.482547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.487578] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1042.487899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.493284] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.523071] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.523071] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.523071] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5fbec70-0464-48ee-8744-b368faac3797 already deleted. [ 1042.523071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.587758] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1042.587961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.613711] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1042.615056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.710635] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1042.710952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.965783] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.965783] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.966483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.968231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.968231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.968231] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 2e10f1e2-c341-4256-b590-954c1ecabf1c not found, creating... [ 1042.968514] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.968710] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.968844] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.969177] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.969290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.969667] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.969866] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.970036] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.970376] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.970539] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.970709] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 2e10f1e2-c341-4256-b590-954c1ecabf1c is going to be created. [ 1042.995704] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.996116] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.996116] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.996290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.996714] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.996802] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.997910] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.998021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.998114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.998676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.998676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.998676] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 is going to be created. [ 1043.030836] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.030836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.031154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.031589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.032227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.045205] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: UNINITIALIZED for 2s [ 1043.253379] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f70850f2-6628-4be4-939e-95e5fadec74b in Status: SUCCESS [ 1043.253582] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f70850f2-6628-4be4-939e-95e5fadec74b deletion is rescheduled due to dependency. [ 1043.253699] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.705041] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5d6727e-507b-405a-8e25-5a62d82cd1ce req-159756d3-b78f-47d8-a66b-5d55c2ee0c04 service nova] Enqueued Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_rules [ 1043.705256] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5d6727e-507b-405a-8e25-5a62d82cd1ce req-159756d3-b78f-47d8-a66b-5d55c2ee0c04 service nova] Enqueued Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1043.705421] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5d6727e-507b-405a-8e25-5a62d82cd1ce req-159756d3-b78f-47d8-a66b-5d55c2ee0c04 service nova] Enqueued Resource ID: 2e10f1e2-c341-4256-b590-954c1ecabf1c with Priority: HIGHEST for action port [ 1043.707787] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_rules [ 1043.708601] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1043.709313] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e10f1e2-c341-4256-b590-954c1ecabf1c with Priority: HIGHEST for action port [ 1043.709730] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.712141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.712141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.712141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.712141] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.712141] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.712141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.712141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.712638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.712716] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.713020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.713020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.713161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.713299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.713364] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.717711] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e10f1e2-c341-4256-b590-954c1ecabf1c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.717886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.719570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.719570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.719570] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e10f1e2-c341-4256-b590-954c1ecabf1c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.788017] env[65353]: INFO networking_nsxv3.common.synchronization [req-5fa43a88-34f7-4404-b30c-dae5522c6306 req-bf9d4284-f231-40fa-bad1-71b1e4933380 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 1043.789543] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGHEST for action security_group_members [ 1043.790391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.790391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.790391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.790391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.790763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.790849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.790912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.791164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.791267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.791862] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.222124] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.226992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.227170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.227977] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e10f1e2-c341-4256-b590-954c1ecabf1c with status ACTIVE [ 1044.227977] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.227977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.227977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.227977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.227977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.230459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.230713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.230851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.231243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.231780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.231780] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.232230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.232230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.232230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.232230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.232936] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e10f1e2-c341-4256-b590-954c1ecabf1c is going to be updated. [ 1044.234941] env[65353]: INFO networking_nsxv3.common.synchronization [req-a240d8cb-9292-46e9-84f6-bfb014221f2c req-aac18dd7-b244-4e62-884a-7deb3b0aafcd tempest-ServersNegativeTestJSON-1226471339 tempest-ServersNegativeTestJSON-1226471339-project-member] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 1044.236518] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGHEST for action security_group_members [ 1044.237423] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.238195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.238195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.238195] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.238642] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.238642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.238642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.238925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.239011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.239329] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.260691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.260691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.260691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.260691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.260691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.261064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e10f1e2-c341-4256-b590-954c1ecabf1c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.295259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.295450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.295560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.295701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.321086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.321444] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.321604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.321672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.321971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.322092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.322226] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be updated. [ 1044.353525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.353661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.353661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.354579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.354579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.366363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: IN_PROGRESS for 2s [ 1044.738538] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.743058] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.743402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.743466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.744064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.744064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.744188] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.744398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.744583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.744975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.744975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.745265] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be updated. [ 1044.782257] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.782517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.782517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.782698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.782931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.793092] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: IN_PROGRESS for 2s [ 1045.056477] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: SUCCESS [ 1045.056694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.056868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.057113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.057393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.057532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.057598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.057761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.057861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.057964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.058048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.243705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.244041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.244041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.244504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.244504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.244504] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5fbec70-0464-48ee-8744-b368faac3797 is going to be created. [ 1045.275029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.275029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.275029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.275029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.275029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.287953] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: UNINITIALIZED for 2s [ 1045.560924] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.064589] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45e4fdd1-656b-4cc6-ba66-7fc4257c0446: rpc.has_security_group_logging(os_id): False [ 1046.073066] env[65353]: INFO networking_nsxv3.common.synchronization [req-39afc4c4-8dc0-4b59-a127-2683a4137218 req-91672fc7-cfb7-4470-8ca8-97c82a14d7aa tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1046.073771] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1046.074806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.074806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.074806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.074806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.075301] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.075301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.075301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.075467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.075531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.075629] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.091359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.091793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.091879] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.092173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.092282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.092718] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.092848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.092896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.093806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.093962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.094140] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 is going to be created. [ 1046.180284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.180284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.180284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.180284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.180284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.204449] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: IN_PROGRESS for 2s [ 1046.377150] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 in Status: SUCCESS [ 1046.377465] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 deletion is rescheduled due to dependency. [ 1046.377465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.580341] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.580860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.581063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.581361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.581547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.581832] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.582063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.582235] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.582483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.582654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.582866] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be deleted. [ 1046.619393] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.619613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.619613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.619987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.619987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.619987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.803153] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 in Status: SUCCESS [ 1046.803893] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 deletion is rescheduled due to dependency. [ 1046.803893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.299724] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: SUCCESS [ 1047.299961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.300185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.300423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.300704] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.300883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.300939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.301093] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.301214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.301327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.301436] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.805617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.805617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.805617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.805617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.805617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.805617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.805617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.806257] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.806257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.806617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.806617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.806617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.806726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.806726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.806793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.808129] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.209052] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: SUCCESS [ 1048.209305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.313036] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5fbec70-0464-48ee-8744-b368faac3797: rpc.has_security_group_logging(os_id): False [ 1048.331252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.331425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.331468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.331652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.331729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.331940] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.332040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.332133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.332245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.332306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.332481] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.332572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.332631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.332795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.332908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.332996] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.333107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.333167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.333286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.333362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.333445] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5fbec70-0464-48ee-8744-b368faac3797 is going to be created. [ 1048.391171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.391318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.391383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.391589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.391780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.404495] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: IN_PROGRESS for 2s [ 1048.502543] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a48dc72c-cb74-41d0-a0a0-da5261f2a9f3 None None] Enqueued Resource ID: 2df6d9ac-6067-49c2-916f-6beac850cf75 with Priority: HIGHEST for action port [ 1048.506296] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df6d9ac-6067-49c2-916f-6beac850cf75 with Priority: HIGHEST for action port [ 1048.506296] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df6d9ac-6067-49c2-916f-6beac850cf75 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.506296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df6d9ac-6067-49c2-916f-6beac850cf75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.506296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df6d9ac-6067-49c2-916f-6beac850cf75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.506296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df6d9ac-6067-49c2-916f-6beac850cf75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.506296] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df6d9ac-6067-49c2-916f-6beac850cf75',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.007812] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2df6d9ac-6067-49c2-916f-6beac850cf75 [ 1049.007812] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.007812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.007812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.008432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.008432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.008432] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2df6d9ac-6067-49c2-916f-6beac850cf75 already deleted. [ 1049.008432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df6d9ac-6067-49c2-916f-6beac850cf75" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.420957] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: SUCCESS [ 1050.421418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.930954] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b90b145f-f64a-4583-96a6-f70d1d21a2b9 None None] Enqueued Resource ID: a95e7f28-3ff6-4185-a474-1cdc6427dd64 with Priority: HIGHEST for action port [ 1051.931742] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a95e7f28-3ff6-4185-a474-1cdc6427dd64 with Priority: HIGHEST for action port [ 1051.932078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a95e7f28-3ff6-4185-a474-1cdc6427dd64 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.932216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a95e7f28-3ff6-4185-a474-1cdc6427dd64" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.932519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a95e7f28-3ff6-4185-a474-1cdc6427dd64" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.932587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a95e7f28-3ff6-4185-a474-1cdc6427dd64" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.932650] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a95e7f28-3ff6-4185-a474-1cdc6427dd64',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.434864] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a95e7f28-3ff6-4185-a474-1cdc6427dd64 [ 1052.435126] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.435263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.435336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.435554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.435642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.435738] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a95e7f28-3ff6-4185-a474-1cdc6427dd64 already deleted. [ 1052.435820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a95e7f28-3ff6-4185-a474-1cdc6427dd64" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.921361] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e03c1726-f924-4f63-a3d7-7964286baab9 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1055.922056] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1055.922192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.922301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.922367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.922612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.922696] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.011309] env[65353]: INFO networking_nsxv3.common.synchronization [None req-05639496-0b58-4570-8782-3e29dad03585 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1056.012147] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1056.012786] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.012786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.445428] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.445580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.445580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.446481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.446481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.446481] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38562f5-e69e-466a-80a0-67c20329559a already deleted. [ 1056.446481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.446481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.446481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.446481] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.973938] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.974280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.974280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.974373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.974470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.974580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38562f5-e69e-466a-80a0-67c20329559a already deleted. [ 1056.974661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.903704] env[65353]: INFO networking_nsxv3.common.synchronization [req-25e55423-4db1-4234-b587-0d04b4731b8a req-e563b1c8-3381-4df1-95f5-5dc5327a5850 tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 1058.904355] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 1058.904674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.904794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.904877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.905500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.905764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.905888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.906096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.906307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.906463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.906563] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.411022] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.912847] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.043212] env[65353]: INFO networking_nsxv3.common.synchronization [req-83a966d2-3c2a-46c3-8169-9f830d4c4a3f req-dafd4757-ca9a-492b-8918-402d1bb17ebb tempest-InstanceActionsTestJSON-648593330 tempest-InstanceActionsTestJSON-648593330-project-member] Enqueued Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1060.044185] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGHEST for action security_group_members [ 1060.044722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.044932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.044932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.045197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.045302] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.045428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.045500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.045658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.045750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.045845] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.148326] env[65353]: INFO networking_nsxv3.common.synchronization [req-b2674bca-8d38-4500-a637-e1aab5da9975 req-4712a1ec-6a13-4087-a900-1d333e7dfeb7 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1060.148813] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1060.149167] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.149310] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.149392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.149598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.149773] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.149883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.150070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.150822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.150822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.150822] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.414841] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.414980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.415219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.415334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.415497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.415602] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 1060.449556] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.449556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.449772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.449860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.450037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.461383] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 1060.503332] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.504021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.504402] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.504752] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.505761] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.507085] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.507085] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.507978] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.507978] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.507978] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.507978] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.507978] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.508222] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.508222] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.509030] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.509030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.529184] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.530287] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.530287] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.530287] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.530287] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-2c066243-6574-4257-ab84-f782ea83bdd0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.530623] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.530623] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.530769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.530902] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c066243-6574-4257-ab84-f782ea83bdd0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.547742] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.547887] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.547951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549390] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549390] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5fbec70-0464-48ee-8744-b368faac3797 is going to be updated. [ 1060.582752] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.582752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.582752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.583118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.583201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.592587] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: IN_PROGRESS for 2s [ 1060.653329] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.033613] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.034045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.034045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.034183] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.034328] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.034489] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 2c066243-6574-4257-ab84-f782ea83bdd0 not found, creating... [ 1061.034720] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.034872] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.034983] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.035280] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.035414] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.035695] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.035846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.035958] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.036206] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.036334] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.036465] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 2c066243-6574-4257-ab84-f782ea83bdd0 is going to be created. [ 1061.056745] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.056983] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.057081] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.057368] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.057607] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.057827] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.156267] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.659467] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.659467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.659467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.659669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.659705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.659829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1061.692419] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.692497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.692533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.693457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.693457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.704340] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1061.762381] env[65353]: INFO networking_nsxv3.common.synchronization [req-b2674bca-8d38-4500-a637-e1aab5da9975 req-dfcdce10-0739-4ba3-887d-a6118cd95a04 service nova] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1061.762566] env[65353]: INFO networking_nsxv3.common.synchronization [req-b2674bca-8d38-4500-a637-e1aab5da9975 req-dfcdce10-0739-4ba3-887d-a6118cd95a04 service nova] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1061.762705] env[65353]: INFO networking_nsxv3.common.synchronization [req-b2674bca-8d38-4500-a637-e1aab5da9975 req-dfcdce10-0739-4ba3-887d-a6118cd95a04 service nova] Enqueued Resource ID: 2c066243-6574-4257-ab84-f782ea83bdd0 with Priority: HIGHEST for action port [ 1061.763259] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_rules [ 1061.763395] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1061.763492] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c066243-6574-4257-ab84-f782ea83bdd0 with Priority: HIGHEST for action port [ 1061.763763] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.763881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.763970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.764158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.764234] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.765556] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.765650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.765833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c066243-6574-4257-ab84-f782ea83bdd0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.765936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.766018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.766167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.766241] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c066243-6574-4257-ab84-f782ea83bdd0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.269417] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c066243-6574-4257-ab84-f782ea83bdd0 with status ACTIVE [ 1062.269862] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.269862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.269862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.270119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.270308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.270454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.271081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.271081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.271081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.271081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.271081] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.271081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.271448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.271448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.271448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.271547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c066243-6574-4257-ab84-f782ea83bdd0 is going to be updated. [ 1062.272780] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.272780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.293891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.294055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.294559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.294559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.294559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.294815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c066243-6574-4257-ab84-f782ea83bdd0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.460516] env[65353]: INFO networking_nsxv3.common.synchronization [req-8efd9fc6-7e3c-4e49-ad22-cabd21938fa3 req-bee67d54-6f07-4f28-8d86-088d0acf8aa3 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1062.461116] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1062.461460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.461615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.461690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.461992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.462085] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.462182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.462254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.462427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.462518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.462632] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.474145] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 1062.474145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.605717] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5fbec70-0464-48ee-8744-b368faac3797 in Status: SUCCESS [ 1062.605950] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5fbec70-0464-48ee-8744-b368faac3797 deletion is rescheduled due to dependency. [ 1062.606116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.772852] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.773261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.773459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.774096] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.774284] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.774539] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.774730] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.775104] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.775340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.775665] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.775848] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.776612] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.776612] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.776612] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.776612] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.776787] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.799829] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.800097] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.800194] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.800433] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.800819] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-0de57b0b-9d9a-427f-9e7d-8490f84c6438 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.800985] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.801109] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.801474] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.802180] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de57b0b-9d9a-427f-9e7d-8490f84c6438',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.965674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.965834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.965904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.966161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.966272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.966482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.966584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.966642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.966799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.966874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.966959] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 already deleted. [ 1062.967050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.305346] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.305698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.305846] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.306087] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.306282] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.306617] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 0de57b0b-9d9a-427f-9e7d-8490f84c6438 not found, creating... [ 1063.307466] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.307613] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.307725] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.308074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.308240] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.308585] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.309087] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.309087] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.309315] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.309522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.310118] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 0de57b0b-9d9a-427f-9e7d-8490f84c6438 is going to be created. [ 1063.331472] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.331742] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.332179] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.332489] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.332899] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.333015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.717697] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1063.717924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.718054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.718321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.718513] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.718629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.718695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.719076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.719076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.719076] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.082827] env[65353]: INFO networking_nsxv3.common.synchronization [req-8efd9fc6-7e3c-4e49-ad22-cabd21938fa3 req-162a6804-4ff6-4117-b117-0d23d06c34ae service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1064.082827] env[65353]: INFO networking_nsxv3.common.synchronization [req-8efd9fc6-7e3c-4e49-ad22-cabd21938fa3 req-162a6804-4ff6-4117-b117-0d23d06c34ae service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1064.083199] env[65353]: INFO networking_nsxv3.common.synchronization [req-8efd9fc6-7e3c-4e49-ad22-cabd21938fa3 req-162a6804-4ff6-4117-b117-0d23d06c34ae service nova] Enqueued Resource ID: 0de57b0b-9d9a-427f-9e7d-8490f84c6438 with Priority: HIGHEST for action port [ 1064.083645] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1064.083727] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1064.083821] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de57b0b-9d9a-427f-9e7d-8490f84c6438 with Priority: HIGHEST for action port [ 1064.084224] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.084347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.084418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.084636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.084722] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.085633] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.085897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.085897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.086450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.086450] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.086450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.086450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.086620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.086620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.086761] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.087508] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de57b0b-9d9a-427f-9e7d-8490f84c6438 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.087621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.088630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.088630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.088630] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de57b0b-9d9a-427f-9e7d-8490f84c6438',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.222426] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.590167] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.591702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.591702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.591702] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0de57b0b-9d9a-427f-9e7d-8490f84c6438 with status ACTIVE [ 1064.591944] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.591944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.591944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.592137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.592223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.592390] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.592482] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.592538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.592678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.592756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.592965] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.593063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.593144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.594532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.594532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.594532] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0de57b0b-9d9a-427f-9e7d-8490f84c6438 is going to be updated. [ 1064.617021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.617021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.617021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.617281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.617386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.617591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de57b0b-9d9a-427f-9e7d-8490f84c6438" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.724652] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.867268] env[65353]: INFO networking_nsxv3.common.synchronization [req-ac395872-4cba-45ea-9ae3-1341baedb919 req-797bd021-d124-444a-9497-4fc376cb3370 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1064.867940] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1064.868594] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.872048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.872048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.872048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.095699] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.227609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.227779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.227851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.228108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.228203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.228326] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1065.255641] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.255896] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.256079] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.256381] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.256644] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.257049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.257180] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.257521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.257678] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.257928] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.258063] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.258533] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.258681] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.258821] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.258939] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.259114] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.263181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.263319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.263394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.263888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.263888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.273256] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1065.283700] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.283873] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.284033] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.284219] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.284600] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.284779] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.284900] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.285319] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.285461] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac154c-abe3-4ae2-9af6-9cf7489d05cb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.375843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.375843] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.375843] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 already deleted. [ 1065.375843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.599000] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.599442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.599442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.599697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.599882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.600140] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be created. [ 1065.630559] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.630814] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.630911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.633937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.633937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.645325] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: UNINITIALIZED for 2s [ 1065.788962] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.789258] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.789340] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.789628] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.789850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.789937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 99ac154c-abe3-4ae2-9af6-9cf7489d05cb not found, creating... [ 1065.790207] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.790389] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.790527] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.790876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.791068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.791397] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.791617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.791753] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.792035] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.792204] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.792357] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 99ac154c-abe3-4ae2-9af6-9cf7489d05cb is going to be created. [ 1065.823302] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.823532] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.823667] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.824014] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.824782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.824782] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.544196] env[65353]: INFO networking_nsxv3.common.synchronization [req-ac395872-4cba-45ea-9ae3-1341baedb919 req-d0658b39-8df1-4df1-9f90-40bf906fd61d service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1066.544196] env[65353]: INFO networking_nsxv3.common.synchronization [req-ac395872-4cba-45ea-9ae3-1341baedb919 req-d0658b39-8df1-4df1-9f90-40bf906fd61d service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1066.544196] env[65353]: INFO networking_nsxv3.common.synchronization [req-ac395872-4cba-45ea-9ae3-1341baedb919 req-d0658b39-8df1-4df1-9f90-40bf906fd61d service nova] Enqueued Resource ID: 99ac154c-abe3-4ae2-9af6-9cf7489d05cb with Priority: HIGHEST for action port [ 1066.544387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1066.544497] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1066.544613] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ac154c-abe3-4ae2-9af6-9cf7489d05cb with Priority: HIGHEST for action port [ 1066.544962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.545532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.545708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.545988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.546085] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.547105] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.547261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.547362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.547652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.547934] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.548052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.548204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.548371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.548510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548650] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.551342] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.551342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.551342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.551342] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac154c-abe3-4ae2-9af6-9cf7489d05cb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.052846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.052846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.053246] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.053967] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ac154c-abe3-4ae2-9af6-9cf7489d05cb with status ACTIVE [ 1067.054172] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.054283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.054348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.054536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.054622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.055811] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.055811] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.055811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.055811] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ac154c-abe3-4ae2-9af6-9cf7489d05cb is going to be updated. [ 1067.079446] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.079721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.079789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.079991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.080210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.080385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ac154c-abe3-4ae2-9af6-9cf7489d05cb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.283688] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1067.283907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.284092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.284300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.284490] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.284598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.284658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.284804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.284881] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.284963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.285069] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.557371] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.656042] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1067.656285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.656451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.656666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.656858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.657101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.657101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.657238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.657294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.657344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.657452] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.789085] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.059451] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.059864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.059864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.059945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.059980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.060080] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be created. [ 1068.086849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.087068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.087068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.087289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.087486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.099190] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: UNINITIALIZED for 2s [ 1068.159935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.160260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.160260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.160472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.160675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.160782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.160906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.161037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.161139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.161254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.161437] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.161544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.161602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.161770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.161917] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.162016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.162090] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.162233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.162318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.162420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.162514] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.290695] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9614eb5-4fb3-4d03-8d1c-b9427ffd4934: rpc.has_security_group_logging(os_id): False [ 1068.310438] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.310596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.310653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.310863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.310948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.311216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.311338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.311396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.311531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.311604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.311690] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1068.374017] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.374263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.374330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.374548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.374724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.390041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1068.664751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 1068.684835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.685174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.685174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.685371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.685464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.685705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.685844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.685967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.686074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.686204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.686492] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.686664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.686740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.686955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.687063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.687264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.687363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.687425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.687650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.687751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.687861] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be created. [ 1068.757645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.757890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.757957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.758250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.758536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.781642] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1069.406123] env[65353]: INFO networking_nsxv3.common.synchronization [req-b5f27264-ea6e-4bec-a630-76c0aead6a8e req-2a7b8afd-3f20-4971-8982-f336dc7d50b1 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 1069.406952] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 with Priority: HIGHEST for action security_group_members [ 1069.407227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.407476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.407476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.407675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.407852] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.407961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.408659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.408738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.408840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.408952] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8cbd2fb-a386-46ba-9054-c04ccc0a46d9',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.860728] env[65353]: INFO networking_nsxv3.common.synchronization [req-a328521e-1180-480b-ad4a-119250ea634a req-1fc7b052-0c71-45d8-b1c8-788baae57426 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1069.860728] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1069.860728] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.860728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.861641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.862056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.862340] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.862568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.862712] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.862954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.863160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.863350] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.914653] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.914653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.914653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.914653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.937098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.937098] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.937098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.937098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.937098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.937098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.937098] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 is going to be updated. [ 1069.963650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.963818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.963880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.964099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.964248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.975040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: IN_PROGRESS for 2s [ 1070.111222] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1070.111305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.111451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.111885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.111885] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.112045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.112045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.112264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.112264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.112391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.112391] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.240903] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.241115] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.241272] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.241566] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.241822] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.241977] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.242103] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.242319] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.242456] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.242655] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.242763] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.242869] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.242997] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.243086] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.243266] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.243399] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.260692] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.260903] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.261027] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.261246] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.261566] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.261737] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.261855] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.262389] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.262537] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ba09fd-b87d-4995-8b24-3e93e0b6a2cc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.366466] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.366466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.366466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.366466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.366466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.366466] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.366868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.366868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.366868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.366980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.367052] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38562f5-e69e-466a-80a0-67c20329559a already deleted. [ 1070.367140] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.406318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1070.406708] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.618029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.618029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.618029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.618029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.618029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.618856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.618856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.618856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.618856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.618856] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.766319] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.766651] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.766831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.767371] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.767636] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.767906] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc not found, creating... [ 1070.768364] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.768664] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.768879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.769262] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.769516] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.769990] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.770283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.770500] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.770856] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.771129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.771390] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc is going to be created. [ 1070.798238] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.798463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.798567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.798919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.799229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.799612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.801250] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1070.801481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.122425] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1071.141227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.141439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.141539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.141782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.141896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.142170] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.142302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.142370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.142568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.142669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.142890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.143032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.143295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.143505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.143626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.143893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.144044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.145251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.145465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.145593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.145728] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be created. [ 1071.208619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.208839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.208839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.209071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.209260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.223277] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1071.418884] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1a84c74a-683c-445b-bf1e-b2b982cfb0f3 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1071.419763] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1071.420554] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.420728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.420808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.421327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.421327] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.421327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.421519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.421605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.421694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.421822] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.573116] env[65353]: INFO networking_nsxv3.common.synchronization [req-a328521e-1180-480b-ad4a-119250ea634a req-9235d6e1-8549-476f-8ceb-1fc5d2c007ea service nova] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1071.573539] env[65353]: INFO networking_nsxv3.common.synchronization [req-a328521e-1180-480b-ad4a-119250ea634a req-9235d6e1-8549-476f-8ceb-1fc5d2c007ea service nova] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1071.573662] env[65353]: INFO networking_nsxv3.common.synchronization [req-a328521e-1180-480b-ad4a-119250ea634a req-9235d6e1-8549-476f-8ceb-1fc5d2c007ea service nova] Enqueued Resource ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with Priority: HIGHEST for action port [ 1071.574922] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1071.574922] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1071.578295] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with Priority: HIGHEST for action port [ 1071.578295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.578295] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.578295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.578295] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.578295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.578295] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.579227] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.579333] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.581321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.585261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.585261] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ba09fd-b87d-4995-8b24-3e93e0b6a2cc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.928190] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.928190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.928190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.928190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.951907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.952285] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.952889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.952889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.952889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.952889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.954067] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1071.986733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.986961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.986961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.987180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.987294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.989691] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 in Status: SUCCESS [ 1071.989691] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8cbd2fb-a386-46ba-9054-c04ccc0a46d9 deletion is rescheduled due to dependency. [ 1071.989691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8cbd2fb-a386-46ba-9054-c04ccc0a46d9" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.004405] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1072.086181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.086686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.087042] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.088552] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with status ACTIVE [ 1072.088873] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.089132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.089577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.090532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.093574] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.093574] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.093574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.093574] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc is going to be updated. [ 1072.125897] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.127171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.127298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.127524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.127700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.127872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.589191] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.093055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.093298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.093378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.093593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.093685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.093785] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be created. [ 1073.123716] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.123889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.123969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.124237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.124431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.139642] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: UNINITIALIZED for 2s [ 1073.240909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1073.241306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.015337] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1074.015795] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 deletion is rescheduled due to dependency. [ 1074.015795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.153207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: SUCCESS [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.153207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.153207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.153902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.153902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.153902] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.656788] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.160420] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a38562f5-e69e-466a-80a0-67c20329559a: rpc.has_security_group_logging(os_id): False [ 1076.183399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.183399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.183399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.183399] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be created. [ 1076.247039] env[65353]: INFO networking_nsxv3.common.synchronization [req-f668a0c5-a7dd-447e-a513-ca6436f74856 req-323b73e4-40f4-46ed-a546-64c69f05bb52 tempest-ServerRescueNegativeTestJSON-1826412746 tempest-ServerRescueNegativeTestJSON-1826412746-project-member] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 1076.249092] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.249440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.249654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.250626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.250626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251811] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGHEST for action security_group_members [ 1076.252131] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.252299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.252405] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.252639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.252861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.252996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.253114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.253297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.253427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.253614] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.268696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: IN_PROGRESS for 2s [ 1076.758608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.758608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.758608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.758608] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be updated. [ 1076.794301] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.794575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.794575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.795180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.795180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.805310] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: IN_PROGRESS for 2s [ 1077.801912] env[65353]: INFO networking_nsxv3.common.synchronization [req-ca7efde3-a7a5-461b-9441-c09283fb9e57 req-70494d3f-f455-499e-84a0-d05457ecdc24 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1077.803938] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1077.803938] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.803938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.803938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.804334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.804512] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.804718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.804718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.804882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.804924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.805015] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.281774] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: SUCCESS [ 1078.282029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.308456] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.308456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.308456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.308456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.308456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.308766] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.308766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.308766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.308899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.308899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.308985] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1078.338955] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.339110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.339178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.339381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.339531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.348630] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1078.435701] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b05f69c7-ef84-4a76-9ad0-0101622f9e23 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: 2751752c-676b-49ed-9bb6-020dd681ab06 with Priority: HIGHEST for action security_group_rules [ 1078.436281] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2751752c-676b-49ed-9bb6-020dd681ab06 with Priority: HIGHEST for action security_group_rules [ 1078.436653] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2751752c-676b-49ed-9bb6-020dd681ab06 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.436794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.436869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.437154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.437238] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2751752c-676b-49ed-9bb6-020dd681ab06',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.524461] env[65353]: INFO networking_nsxv3.common.synchronization [None req-1c081bfd-0ccf-4ab6-9624-ffd175626ed3 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: 2751752c-676b-49ed-9bb6-020dd681ab06 with Priority: HIGHEST for action security_group_rules [ 1078.525249] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2751752c-676b-49ed-9bb6-020dd681ab06 with Priority: HIGHEST for action security_group_rules [ 1078.525334] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2751752c-676b-49ed-9bb6-020dd681ab06 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.525507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.818542] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b in Status: SUCCESS [ 1078.818542] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b deletion is rescheduled due to dependency. [ 1078.818542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.905139] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.905370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.905639] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.905822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.906112] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.906280] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.906427] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.906709] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.906869] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.907182] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.907360] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.907445] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.907591] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.907714] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.907883] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.907964] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.930107] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.930107] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.930329] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.930329] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.930638] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-b5752b29-cd46-437f-9022-6bbc15e0b790 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.930807] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.930923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.931362] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.931511] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5752b29-cd46-437f-9022-6bbc15e0b790',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.962282] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.962632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.962722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.962950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.963060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.963182] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2751752c-676b-49ed-9bb6-020dd681ab06 already deleted. [ 1078.963400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.963595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.963753] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.963841] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2751752c-676b-49ed-9bb6-020dd681ab06',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.433923] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.434139] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.434333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.434750] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.435073] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.435292] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port b5752b29-cd46-437f-9022-6bbc15e0b790 not found, creating... [ 1079.435629] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.435879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.435956] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.436252] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.436403] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.437170] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.437384] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.437470] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.437687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.437876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.438105] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: b5752b29-cd46-437f-9022-6bbc15e0b790 is going to be created. [ 1079.466524] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.466854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.466950] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.467277] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.467595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.467851] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.493518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.493691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.493815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.494350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.494516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.494692] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2751752c-676b-49ed-9bb6-020dd681ab06 already deleted. [ 1079.494820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2751752c-676b-49ed-9bb6-020dd681ab06" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.184495] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5027719-624d-407d-8b15-5b0c07387143 req-25ea1c03-9b1a-4483-a5d8-d7b59efc3d03 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 1080.184781] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5027719-624d-407d-8b15-5b0c07387143 req-25ea1c03-9b1a-4483-a5d8-d7b59efc3d03 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1080.184781] env[65353]: INFO networking_nsxv3.common.synchronization [req-e5027719-624d-407d-8b15-5b0c07387143 req-25ea1c03-9b1a-4483-a5d8-d7b59efc3d03 service nova] Enqueued Resource ID: b5752b29-cd46-437f-9022-6bbc15e0b790 with Priority: HIGHEST for action port [ 1080.185370] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 1080.185507] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1080.185599] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5752b29-cd46-437f-9022-6bbc15e0b790 with Priority: HIGHEST for action port [ 1080.185882] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.186112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.186193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.186500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.186589] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.187535] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.187647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.187707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.187877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.188049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.188156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.188225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.188377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.188466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.188542] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.192240] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5752b29-cd46-437f-9022-6bbc15e0b790 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.192240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.192240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.192240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.192240] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5752b29-cd46-437f-9022-6bbc15e0b790',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.357810] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1080.358020] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1080.358227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.692087] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.693357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.693357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.695198] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5752b29-cd46-437f-9022-6bbc15e0b790 with status ACTIVE [ 1080.695506] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.695637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.695719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.696082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.696082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.696272] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.696374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.696432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.696627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.696704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.696896] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.697010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.697076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.697219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.697305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.697391] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5752b29-cd46-437f-9022-6bbc15e0b790 is going to be updated. [ 1080.719052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.719242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.719242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.719406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.719541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.719703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.195137] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.698653] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.698873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.698954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.699180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.699271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.699401] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1081.730771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.731075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.731075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.731249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.731491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.739978] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1082.128220] env[65353]: INFO networking_nsxv3.common.synchronization [req-cbde504d-3d3a-498c-ab1f-4cadac0d6402 req-3b1b8ff2-bd05-4d53-9c18-db63f238e4ba tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1082.128431] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1082.128792] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.129239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.129239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.129239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.129641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.129641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.129641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.130863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.130863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.130863] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.632538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.632893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.632893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.632976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.633064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.633273] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.633457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.633523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.633673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.633750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.634056] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1082.665018] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.665018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.665018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.665018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.665018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.676336] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1082.926448] env[65353]: INFO networking_nsxv3.common.synchronization [req-1e798ef3-1287-46c1-8fa5-55a97758fb5b req-b7e136b0-6389-4af6-8aea-03bd05bacb6a tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1082.927074] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1082.927400] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.927677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.927759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.927967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.928137] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.928270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.928350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.928525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.928629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.928721] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.253088] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.253297] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.253418] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.253721] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.253976] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.254147] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.254263] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.254473] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.254615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.254819] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.254930] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.255063] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.255177] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.255288] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.255445] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.255569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.275886] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.276170] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.276435] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.276619] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.276945] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f74f2977-c220-4253-ba9d-a8bfa8023455 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.277195] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.277346] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.277710] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.277876] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f74f2977-c220-4253-ba9d-a8bfa8023455',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.430589] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.751193] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1083.751632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.751632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.752085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.752085] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.752238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.752238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.752314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.752477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.752477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.752600] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.779941] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.780586] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.780586] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.780586] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.780893] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.780893] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f74f2977-c220-4253-ba9d-a8bfa8023455 not found, creating... [ 1083.781143] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.781450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.781450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.781666] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.781733] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.782076] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.782242] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.782357] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.782567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.782690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.782831] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f74f2977-c220-4253-ba9d-a8bfa8023455 is going to be created. [ 1083.808717] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.808952] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.809106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.809413] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.809710] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.809880] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.932695] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.255469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.255633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.255711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.255924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.256180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.256355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.256458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.256649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.256787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.256946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.257128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.257226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.257287] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.257450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.257600] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.257676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.257730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.257861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.257934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.258016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.259291] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.435710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.435710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.435961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.436028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.436165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.436242] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1084.465575] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.466039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.466039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.466039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.466191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.476063] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1084.686822] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1084.686957] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1084.687071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.761619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e718fc6-a572-4276-83ab-0e7e530140d0: rpc.has_security_group_logging(os_id): False [ 1084.789737] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.789913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.789963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.790263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.790391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.790625] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.790737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.790845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.791040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.791153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.791380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.791508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.791579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.791751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.791849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.792082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.792172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.792272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.792425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.792527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.792635] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1084.919447] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.919735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.919735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.920066] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.920330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.944146] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1085.012677] env[65353]: INFO networking_nsxv3.common.synchronization [req-1e798ef3-1287-46c1-8fa5-55a97758fb5b req-0c147d1c-35b0-450c-a607-8851e6609d92 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1085.012860] env[65353]: INFO networking_nsxv3.common.synchronization [req-1e798ef3-1287-46c1-8fa5-55a97758fb5b req-0c147d1c-35b0-450c-a607-8851e6609d92 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1085.013013] env[65353]: INFO networking_nsxv3.common.synchronization [req-1e798ef3-1287-46c1-8fa5-55a97758fb5b req-0c147d1c-35b0-450c-a607-8851e6609d92 service nova] Enqueued Resource ID: f74f2977-c220-4253-ba9d-a8bfa8023455 with Priority: HIGHEST for action port [ 1085.013504] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1085.013637] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1085.013743] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f74f2977-c220-4253-ba9d-a8bfa8023455 with Priority: HIGHEST for action port [ 1085.014026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.014339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.014408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.014602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.014734] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.015595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.015691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.017229] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f74f2977-c220-4253-ba9d-a8bfa8023455 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.017229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.017229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.017229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.017229] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f74f2977-c220-4253-ba9d-a8bfa8023455',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.518913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.519062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.519247] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f74f2977-c220-4253-ba9d-a8bfa8023455 with status ACTIVE [ 1085.519413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.519519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.519574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.519781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.519868] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.520036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.520124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.520181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.520337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.520412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.520597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.520687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.520742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.520880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.521276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.521276] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f74f2977-c220-4253-ba9d-a8bfa8023455 is going to be updated. [ 1085.543650] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.543797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.543855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.544095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.544241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.544404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f74f2977-c220-4253-ba9d-a8bfa8023455" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.486103] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1086.486528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.486528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.486834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.487499] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.487499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.487499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.487499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.487499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.487807] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.962412] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1086.962524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.990678] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.495802] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.998913] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.999168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.999322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.999662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.999799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.999980] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1088.035135] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.035293] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.035381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.035630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.035783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.046570] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1089.928471] env[65353]: INFO networking_nsxv3.common.synchronization [req-5d0529e8-236a-42c1-a2fd-8cfc1ac96fe6 req-71f8a782-7e9d-4e29-ba7e-1dc72fb98f40 tempest-ServersTestManualDisk-744346416 tempest-ServersTestManualDisk-744346416-project-member] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1089.929045] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGHEST for action security_group_members [ 1089.929336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.929474] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.929538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.929736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.929894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.929984] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.930890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.930890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.930890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.930890] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.060975] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1090.061226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.062079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.062079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.062276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.062436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.062494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.062609] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.062697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.062785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.062870] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.433166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.433324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.433399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.434083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.434285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.434721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.434721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.434721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.434916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.434916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.434999] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 is going to be updated. [ 1090.464035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.464035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.464256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.464295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.464550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.473422] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: IN_PROGRESS for 2s [ 1090.566692] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.566959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.567075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.567382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.567599] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.568264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.568264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.568264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.568264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.568264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.568520] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.568520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.568520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.568649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.568702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.568785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.568843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.568976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.569067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.569152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.569256] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.071132] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1091.092887] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.093127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.093127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.093317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.093497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.093733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.093832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.093902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.094075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.094155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.094345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.094438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.094493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.094630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.094703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.094878] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.094968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.095040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.095175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.095249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.095331] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1091.191078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.191722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.191722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.191722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.191722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.208277] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1092.484820] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 in Status: SUCCESS [ 1092.484820] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 deletion is rescheduled due to dependency. [ 1092.484820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.882128] env[65353]: INFO networking_nsxv3.common.synchronization [req-5548fbfa-33db-40b6-ba40-f6109585a7f4 req-a254e2db-d5b5-40c9-80f0-344fcd96a539 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1092.882918] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1092.883317] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.883473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.883560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.883948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.884175] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.884270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.884314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.884484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.884580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.884683] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.235173] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1093.235173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.284296] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.284482] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.284607] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.284945] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.285256] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.285365] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.285409] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.286021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.286021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.286217] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.286400] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.286638] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.286809] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.286973] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.287148] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.287328] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.307068] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.307496] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.307496] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.307711] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.308220] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-f7612fcf-3b20-46cc-a193-7f8c68142443 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.308417] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.308582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.309099] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.309233] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7612fcf-3b20-46cc-a193-7f8c68142443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.387160] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.387330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.387382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.387705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.387705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.387946] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.388053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.388151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.388268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.388334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.388415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1093.414052] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.414238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.414283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.414483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.414629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.423944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1093.812472] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.812776] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.812901] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.813182] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.813351] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.813507] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port f7612fcf-3b20-46cc-a193-7f8c68142443 not found, creating... [ 1093.813805] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.813966] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.814104] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.814332] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.814471] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.814800] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.815049] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.815237] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.815395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.815554] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.815701] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: f7612fcf-3b20-46cc-a193-7f8c68142443 is going to be created. [ 1093.843181] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.843545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.843545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.843838] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.844077] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.844305] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.088506] env[65353]: INFO networking_nsxv3.common.synchronization [req-5548fbfa-33db-40b6-ba40-f6109585a7f4 req-f8efa874-590b-442a-85b1-33c9f9bf2121 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1095.088839] env[65353]: INFO networking_nsxv3.common.synchronization [req-5548fbfa-33db-40b6-ba40-f6109585a7f4 req-f8efa874-590b-442a-85b1-33c9f9bf2121 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1095.088961] env[65353]: INFO networking_nsxv3.common.synchronization [req-5548fbfa-33db-40b6-ba40-f6109585a7f4 req-f8efa874-590b-442a-85b1-33c9f9bf2121 service nova] Enqueued Resource ID: f7612fcf-3b20-46cc-a193-7f8c68142443 with Priority: HIGHEST for action port [ 1095.089453] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1095.089584] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1095.089682] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7612fcf-3b20-46cc-a193-7f8c68142443 with Priority: HIGHEST for action port [ 1095.089958] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.090159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.090227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.090430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.090512] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.091893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.092048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.092338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7612fcf-3b20-46cc-a193-7f8c68142443 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.092501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.092605] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.092878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.093010] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7612fcf-3b20-46cc-a193-7f8c68142443',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.435151] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1095.435151] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1095.435151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.435151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.435151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.435341] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.435402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.435739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.435739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.435739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.435866] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.438476] env[65353]: INFO networking_nsxv3.common.synchronization [req-b21a1ab7-543b-420e-8e99-cfbf1b704a07 req-65b731eb-b45e-4d67-87c3-932653cdfdbd tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1095.439020] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1095.439279] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.439388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.439450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.439612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.439759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.439854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.439980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.440157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.440239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.440330] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.595235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.595328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.595629] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7612fcf-3b20-46cc-a193-7f8c68142443 with status ACTIVE [ 1095.595806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.595910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.595974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.596475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.596475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.596475] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.596677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.596677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.596792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.596792] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.597047] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.597047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.597138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.597254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.597740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.597740] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7612fcf-3b20-46cc-a193-7f8c68142443 is going to be updated. [ 1095.624263] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.624263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.624263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.624471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.625379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.625677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7612fcf-3b20-46cc-a193-7f8c68142443" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.848679] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.848868] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.848918] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.849221] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.849512] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.849647] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.849755] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.849976] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.850129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.850360] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.850474] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.850580] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.850917] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.850917] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.850917] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.851159] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.883933] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.885289] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.885289] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.885289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.889186] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-9e613a3f-ee12-42d4-8541-76a93fa5ae46 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.889431] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.889556] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.890131] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.890484] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e613a3f-ee12-42d4-8541-76a93fa5ae46',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.940234] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.942265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.942421] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.942487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.942685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.942779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.942964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.943083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.943132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.943275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.943353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.943458] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be deleted. [ 1095.981248] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.981548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.981548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.981688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.981754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.981845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.396490] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.396843] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.396955] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.397393] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.397836] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.398369] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 9e613a3f-ee12-42d4-8541-76a93fa5ae46 not found, creating... [ 1096.398437] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.398973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.398973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.399135] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.399491] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.399865] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.400093] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.400254] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.400546] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.400705] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.400915] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 is going to be created. [ 1096.421957] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.422214] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.422316] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.422599] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.422836] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.423086] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.442642] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.945742] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.946406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.946567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.946878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.947029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.947190] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1096.981939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.982184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.982306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.982661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.982856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.993596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1097.189258] env[65353]: INFO networking_nsxv3.common.synchronization [req-b21a1ab7-543b-420e-8e99-cfbf1b704a07 req-e2d15c00-408c-4346-bf59-739b97eafd48 service nova] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_rules [ 1097.189258] env[65353]: INFO networking_nsxv3.common.synchronization [req-b21a1ab7-543b-420e-8e99-cfbf1b704a07 req-e2d15c00-408c-4346-bf59-739b97eafd48 service nova] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1097.189258] env[65353]: INFO networking_nsxv3.common.synchronization [req-b21a1ab7-543b-420e-8e99-cfbf1b704a07 req-e2d15c00-408c-4346-bf59-739b97eafd48 service nova] Enqueued Resource ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with Priority: HIGHEST for action port [ 1097.189258] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_rules [ 1097.189258] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1097.189682] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with Priority: HIGHEST for action port [ 1097.189682] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.189682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.190048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.190048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.190048] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.190865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.190978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.191038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.191201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.191341] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.191430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.191491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.191626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.191903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.192021] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.194522] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e613a3f-ee12-42d4-8541-76a93fa5ae46 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.194653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.194722] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.195776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.195776] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e613a3f-ee12-42d4-8541-76a93fa5ae46',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.235947] env[65353]: INFO networking_nsxv3.common.synchronization [req-e02374be-2411-4519-b3c1-00de985d2115 req-b16635b9-aee8-48ec-8cde-78814da86b95 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1097.237101] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1097.237101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.237101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.237101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.237101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.237509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.237509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.237509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.237509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.237676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.237676] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.667912] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.668290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.668290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.668600] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.668905] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.669166] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.669401] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.669708] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.669962] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.670317] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.670499] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.670657] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.670782] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.670901] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.671015] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.671158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.692553] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.692804] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.692992] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.693245] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-603" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.693978] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-b5752b29-cd46-437f-9022-6bbc15e0b790 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.694290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.694705] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.694826] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.695050] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5752b29-cd46-437f-9022-6bbc15e0b790',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.696285] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.696417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.696639] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.699922] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with status ACTIVE [ 1097.700230] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.700850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.700850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.700850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.700850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.700850] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.701096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.701096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.701175] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.701224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.701404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.701486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.702106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.702106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.702106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.702106] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 is going to be updated. [ 1097.721817] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.722089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.722089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.722304] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.722467] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.722687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.739042] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.198736] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.198958] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.199102] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.199401] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.199552] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.199849] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.200011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.200132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.200350] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.200486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.200762] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.200917] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.201050] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.201267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.201395] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.201634] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: b5752b29-cd46-437f-9022-6bbc15e0b790 is going to be updated. [ 1098.202788] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.223710] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.223973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.224076] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.224320] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.224522] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.224739] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.241746] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.706367] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.706777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.706777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.707125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.707290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.707460] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be created. [ 1098.730833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.731059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.731106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.731447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.731728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.741884] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: UNINITIALIZED for 2s [ 1098.744455] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.744623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.744681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.745015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.745124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.745224] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1098.772556] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.772690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.772760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.772962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.773150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.782381] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1098.921344] env[65353]: INFO networking_nsxv3.common.synchronization [req-59975b08-5738-4ffc-b9a8-58177562597e req-c77c2027-25ef-481c-9cf1-6872981dd284 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 1098.921651] env[65353]: INFO networking_nsxv3.common.synchronization [req-59975b08-5738-4ffc-b9a8-58177562597e req-c77c2027-25ef-481c-9cf1-6872981dd284 service nova] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1098.921968] env[65353]: INFO networking_nsxv3.common.synchronization [req-59975b08-5738-4ffc-b9a8-58177562597e req-c77c2027-25ef-481c-9cf1-6872981dd284 service nova] Enqueued Resource ID: b5752b29-cd46-437f-9022-6bbc15e0b790 with Priority: HIGHEST for action port [ 1098.922572] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_rules [ 1098.922880] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1098.922880] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5752b29-cd46-437f-9022-6bbc15e0b790 with Priority: HIGHEST for action port [ 1098.923245] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.923604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.923604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.923701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.923753] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.925720] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.925849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.925913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.926186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.926258] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.926396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.926441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.926799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.926799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.926799] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.927575] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5752b29-cd46-437f-9022-6bbc15e0b790 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.927678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.927743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.927934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.928026] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5752b29-cd46-437f-9022-6bbc15e0b790',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.005662] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1099.005882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.006054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.006263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.006454] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.006589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.006652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.006800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.006876] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.006956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.007054] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.429329] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.429497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.429705] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.430646] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5752b29-cd46-437f-9022-6bbc15e0b790 with status ACTIVE [ 1099.430902] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.431060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.431126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.431362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.431443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.431617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.431713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.431774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.431927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.432016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.432204] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.432303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.432365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.432524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.432571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.432656] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5752b29-cd46-437f-9022-6bbc15e0b790 is going to be updated. [ 1099.454365] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.454587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.454587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.454754] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.454884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.455056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5752b29-cd46-437f-9022-6bbc15e0b790" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.509729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.509976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.509976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.510690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.510690] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.510690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.510690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.510975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.510975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.510975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.511107] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.511107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.511197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.511312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.511449] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.511537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.511597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.511731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.511805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.511884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.511976] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.934607] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.016344] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 1100.035940] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.036299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.036299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.036738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.038553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.038821] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.038934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.038990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.039191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.039279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.039472] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.039567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.039626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.039756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.039831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.040033] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.041988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.042171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.042269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.042387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.042387] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1100.106967] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.107171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.107171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.107401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.107552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.127365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1100.156162] env[65353]: INFO networking_nsxv3.common.synchronization [req-53277d86-f654-4d56-a7d1-27bf422e4545 req-dc887661-4830-42d0-af34-e19203f677a7 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1100.156902] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1100.157336] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.157606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.157698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.158132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.158345] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.158345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.158438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.158584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.158674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.158782] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.437830] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.438025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.438086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.438303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.438428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.438565] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1100.474570] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.474702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.474730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.474938] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.475103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.479459] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.479459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.479459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.479459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.479459] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.479757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.479757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.480074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.480144] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.481229] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.481229] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.481229] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.481229] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.481229] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.481229] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.481229] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.485746] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1100.506942] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.506942] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.507105] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.507251] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.507575] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.507774] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.507919] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.508271] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.509023] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213382be-ce7b-4f07-9e9d-db7ea5dc97ca',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.661193] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.661575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.661651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.661860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.661950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.662173] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.662273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.662331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.662459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.662531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.662614] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1100.690141] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.690141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.690248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.690393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.690533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.701547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1100.750798] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: UNINITIALIZED for 4s [ 1100.792690] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1100.792946] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.010468] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.010831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.010831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.011116] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.011268] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.011421] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 213382be-ce7b-4f07-9e9d-db7ea5dc97ca not found, creating... [ 1101.011682] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.011841] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.011954] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.012189] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.012325] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.012618] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.012773] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.012889] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.013132] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.013267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.013404] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 213382be-ce7b-4f07-9e9d-db7ea5dc97ca is going to be created. [ 1101.043411] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.043763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.043944] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.044303] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.044633] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.044939] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.809383] env[65353]: INFO networking_nsxv3.common.synchronization [req-53277d86-f654-4d56-a7d1-27bf422e4545 req-c8027745-81fd-43e7-9548-0c06744fb33a service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1101.809606] env[65353]: INFO networking_nsxv3.common.synchronization [req-53277d86-f654-4d56-a7d1-27bf422e4545 req-c8027745-81fd-43e7-9548-0c06744fb33a service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1101.809766] env[65353]: INFO networking_nsxv3.common.synchronization [req-53277d86-f654-4d56-a7d1-27bf422e4545 req-c8027745-81fd-43e7-9548-0c06744fb33a service nova] Enqueued Resource ID: 213382be-ce7b-4f07-9e9d-db7ea5dc97ca with Priority: HIGHEST for action port [ 1101.810289] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1101.811119] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1101.811293] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213382be-ce7b-4f07-9e9d-db7ea5dc97ca with Priority: HIGHEST for action port [ 1101.811606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.811732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.811799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.812032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.812114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.813057] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.813164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.813445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.813565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.813634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.813834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.813912] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213382be-ce7b-4f07-9e9d-db7ea5dc97ca',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.142799] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1102.143160] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.316101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.316262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.316427] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 213382be-ce7b-4f07-9e9d-db7ea5dc97ca with status ACTIVE [ 1102.316594] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.316695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.316764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.317232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.317232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.317232] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.317400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.317400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.317518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.317589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.318268] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.318268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.318268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.318268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.318471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.318471] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 213382be-ce7b-4f07-9e9d-db7ea5dc97ca is going to be updated. [ 1102.353407] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.354104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.354262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.354439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213382be-ce7b-4f07-9e9d-db7ea5dc97ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.498156] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1102.498430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.498858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.498926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.499100] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.499367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.499367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.499988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.499988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.499988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.499988] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.714439] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1102.714689] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1102.714849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.715098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.715390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.715651] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.715969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.715969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.716189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.716262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.716395] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.760899] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 1102.761141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.761357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.761579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.761769] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.761883] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.761944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.762099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.762177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.762258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.762344] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.001943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.002236] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.002371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.002617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.002801] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.002932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.003038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.003257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.003401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.003533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.003761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.003908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.004018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.004231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.004432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.004589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.004695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.004846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.004925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.005015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.005110] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.219202] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.264853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.265075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.265203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.265439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.265722] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.265823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.265894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.266094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.266187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.266278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.266435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.266528] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.266678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.266833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.266981] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.267088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.267148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.267298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.267375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.267461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.267551] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.507590] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e718fc6-a572-4276-83ab-0e7e530140d0: rpc.has_security_group_logging(os_id): False [ 1103.526373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.526593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.526711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.527039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.527151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.527362] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.527469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.527529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.527682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.528476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.528476] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.528476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.528476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.528730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.528830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.529101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.530446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.530446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.530570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.530695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.530814] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1103.623360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.623360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.624799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.626980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.626980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.638652] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1103.723929] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.769871] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6201df91-3340-45fd-8fb5-eb672e417941: rpc.has_security_group_logging(os_id): False [ 1103.791606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.791773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.791773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.791972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.792077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.792302] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.792417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.792485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.792648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.792725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.792914] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.793014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.793079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.793217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.793289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.793465] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.793558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.793644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.793797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.793871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.793956] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be created. [ 1103.874845] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.874979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.874979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.875164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.875584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.890960] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: IN_PROGRESS for 2s [ 1104.229106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.229476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.229476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.229476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.229595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.229660] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1104.263847] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.265270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.269285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.269285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.269285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.278480] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1105.652457] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1105.652816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.905538] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 1105.906020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.289591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1106.289762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.289931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.290156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.290340] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.290450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.290508] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.290668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.290757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.290839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.290932] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.794141] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.794410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.794410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.794689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.795042] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.795198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.795303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.795918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.796047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.796564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.796660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.796823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.796972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.797079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.797146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.797272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.797361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.797432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.797565] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.812201] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1106.812387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1107.299607] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 1107.322362] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.322362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.322362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.322362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.322583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.322670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.322779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.322836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.322982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.323069] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.323241] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.323331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.323391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.323540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.323625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.323814] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.323904] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.323966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.324137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.324210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.324293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1107.395592] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.395592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.395859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.396130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.396339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.409314] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1107.616662] env[65353]: INFO networking_nsxv3.common.synchronization [req-5d253daf-4935-4257-8050-92d6cfd415f2 req-10fa9cef-44fd-4007-8756-8fb7134d0cd8 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1107.616662] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGHEST for action security_group_members [ 1107.616872] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.617119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.617202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.617514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.617723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.617837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.617898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.618391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.618391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.618391] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.671770] env[65353]: INFO networking_nsxv3.common.synchronization [req-5d253daf-4935-4257-8050-92d6cfd415f2 req-10fa9cef-44fd-4007-8756-8fb7134d0cd8 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with Priority: HIGHEST for action port [ 1107.672498] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with Priority: HIGHEST for action port [ 1107.673067] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e613a3f-ee12-42d4-8541-76a93fa5ae46 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.673240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.673378] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.673691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.673836] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e613a3f-ee12-42d4-8541-76a93fa5ae46',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.120413] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.120777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.120777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.120939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.120939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.121328] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.121520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.121592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.121850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.121972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.122169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be updated. [ 1108.151533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.151692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.151799] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.152062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.152210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.296810] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e613a3f-ee12-42d4-8541-76a93fa5ae46 with status ACTIVE [ 1108.297115] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.297222] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.297258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.297613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.297613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.297742] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.298619] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.298619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.298957] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e613a3f-ee12-42d4-8541-76a93fa5ae46 is going to be updated. [ 1108.311644] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: IN_PROGRESS for 2s [ 1108.325103] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.325244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.325303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.325511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.325711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.325923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e613a3f-ee12-42d4-8541-76a93fa5ae46" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.424827] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1109.425188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.321989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6201df91-3340-45fd-8fb5-eb672e417941 in Status: SUCCESS [ 1110.322205] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 deletion is rescheduled due to dependency. [ 1110.322325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.567101] env[65353]: INFO networking_nsxv3.common.synchronization [req-19150895-c85d-444c-af6b-ccb43eddd3f3 req-ccd37eaf-cad3-4536-bdf6-6d7d181c7cb8 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1111.567689] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1111.568044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.568163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.568205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.568396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.568551] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.568641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.568702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.568841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.568922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.569020] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.955755] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.956043] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.956207] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.956455] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.956753] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.956912] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.957044] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.957269] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.957436] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.957674] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.957783] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.957906] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.958082] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.958215] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.958320] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.958450] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.985419] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.985717] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.985905] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.986217] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.986729] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-4aa77672-c54e-41ee-98f2-3c6c87c20f78 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.987030] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.987233] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.987941] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.987941] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa77672-c54e-41ee-98f2-3c6c87c20f78',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.070762] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.492281] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.492281] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.492281] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.492666] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.492829] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.493090] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 4aa77672-c54e-41ee-98f2-3c6c87c20f78 not found, creating... [ 1112.493346] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.493486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.493599] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.493884] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.494042] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.494741] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.494741] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.494741] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.494921] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.495026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.495142] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 4aa77672-c54e-41ee-98f2-3c6c87c20f78 is going to be created. [ 1112.523746] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.524019] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.524150] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.524452] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.524687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.524980] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.574360] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.077537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.077710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.077748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.077973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.078077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.078177] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1113.108947] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.109309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.109410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.109665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.109824] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.119665] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1113.260922] env[65353]: INFO networking_nsxv3.common.synchronization [req-19150895-c85d-444c-af6b-ccb43eddd3f3 req-658ae737-e989-4c11-b46b-7042a1cda039 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1113.261112] env[65353]: INFO networking_nsxv3.common.synchronization [req-19150895-c85d-444c-af6b-ccb43eddd3f3 req-658ae737-e989-4c11-b46b-7042a1cda039 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1113.261248] env[65353]: INFO networking_nsxv3.common.synchronization [req-19150895-c85d-444c-af6b-ccb43eddd3f3 req-658ae737-e989-4c11-b46b-7042a1cda039 service nova] Enqueued Resource ID: 4aa77672-c54e-41ee-98f2-3c6c87c20f78 with Priority: HIGHEST for action port [ 1113.261746] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1113.261883] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1113.261977] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa77672-c54e-41ee-98f2-3c6c87c20f78 with Priority: HIGHEST for action port [ 1113.262352] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.262513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.262644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.262962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.263053] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.264073] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.264169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.264684] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa77672-c54e-41ee-98f2-3c6c87c20f78 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.264794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.264855] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.265787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.265787] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa77672-c54e-41ee-98f2-3c6c87c20f78',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.766974] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.767359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.767402] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aa77672-c54e-41ee-98f2-3c6c87c20f78 with status ACTIVE [ 1113.767639] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.767773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.767847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.768129] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.768255] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.768460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.768582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.768649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.768877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.768968] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.769177] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.769272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.769332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.769526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.769621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.769711] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aa77672-c54e-41ee-98f2-3c6c87c20f78 is going to be updated. [ 1113.802166] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.802343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.802417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.802685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.802862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.803063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa77672-c54e-41ee-98f2-3c6c87c20f78" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.057762] env[65353]: INFO networking_nsxv3.common.synchronization [req-964b4015-6c1a-4750-a7ea-46d754e143f1 req-73198c69-db01-4386-9673-add93b1c016c tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1115.057762] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1115.057762] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.057762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.057762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.057762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.057762] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.057762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.057762] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.058659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.058659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.058659] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.131329] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1115.131647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.132088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.132345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.132629] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.132845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.132981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.133278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.133355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.133515] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.561416] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.636238] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.063544] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.139183] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.566093] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.566299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.566401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.566629] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.566729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.566845] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1116.594235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.594416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.594485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.594645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.594800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.603742] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1116.641646] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.641646] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.641866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.642217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.642397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.642597] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1116.670486] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.670647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.670701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.670920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.671083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.680433] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1116.999111] env[65353]: INFO networking_nsxv3.common.synchronization [req-50efe216-9a3d-414f-bf26-a4df8efe4634 req-74d8dc22-d643-4c77-8d24-24337d26f446 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1116.999491] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1117.000158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.000158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.000342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.000462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.000645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.001157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.001157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.001157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.001157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.001157] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.503943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.504321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.504321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.504469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.504599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.505320] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.505505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.505583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.505841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.505940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.506051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1117.534457] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.534622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.534622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.534811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.535056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.543705] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1118.615453] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1118.615970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.689672] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1118.689902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.690105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.690345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.690546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.690664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.690741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.690896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.691010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.691123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.691277] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.195972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.196207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.196274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.196538] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.196731] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.196884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.196975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.197107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.197199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.197277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.197432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.197536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.197595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.197738] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.197881] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.197972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.198043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.198183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.198262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.198344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.198430] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.555051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1119.555153] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1119.555296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.702038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1119.727828] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.727976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.728048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.728296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.728388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.728609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.728707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.728810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.728937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.729025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.729212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.729314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.729389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.729527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.729569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.729744] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.729833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.729956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.730032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.730102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.730186] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1119.791941] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.792118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.792161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.792626] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.792783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.811401] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1121.828551] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1121.828974] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.001449] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.001566] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.724861] env[65353]: INFO networking_nsxv3.common.synchronization [req-3e9aa6b6-4a44-4245-90a3-23cde3b2e738 req-edd25f38-0ba7-42bb-b31b-0e454f834a9a tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1122.725101] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGHEST for action security_group_members [ 1122.725711] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.725711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.725955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.726120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.726255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.726398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.726459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.726630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.726704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.726804] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.878021] env[65353]: INFO networking_nsxv3.common.synchronization [req-b790b4c4-c704-4f2f-b6fd-b694c75f3744 req-18f6d32f-ceee-4c46-aa74-2717a2784596 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1122.878875] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1122.881452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.881452] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.881452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.881452] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.229360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.229641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.229757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.229993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.230104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.230334] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.230436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.230498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.230669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.230766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.230824] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be updated. [ 1123.272796] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.272796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.272796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.272796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.272796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.284687] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: IN_PROGRESS for 2s [ 1123.383736] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.886183] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.388435] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.388589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.388826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.388885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.388991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.389052] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1124.440439] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.440439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.440600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.440821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.441021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.452678] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1125.297078] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 in Status: SUCCESS [ 1125.297078] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 deletion is rescheduled due to dependency. [ 1125.297078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.463204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1126.463602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.276667] env[65353]: INFO networking_nsxv3.common.synchronization [None req-940b4afd-24f0-4389-b6a5-56d9421cf682 tempest-AttachInterfacesTestJSON-2030993203 tempest-AttachInterfacesTestJSON-2030993203-project-member] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1127.277250] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGHEST for action security_group_members [ 1127.277565] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.277683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.277746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.277947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.278108] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.278202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.278252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.278397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.278483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.278565] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.780623] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.780990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.780990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.781616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.781616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.781877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.782183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.782183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.782443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.782627] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.783592] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be updated. [ 1127.814935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.815146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.815187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.815398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.815546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.825265] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: IN_PROGRESS for 2s [ 1129.849729] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 in Status: SUCCESS [ 1129.849969] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 deletion is rescheduled due to dependency. [ 1129.850147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.039878] env[65353]: INFO networking_nsxv3.common.synchronization [req-0bf8ef5a-fea0-43c3-a195-31369cfab25f req-8956c8ef-b339-471c-ac22-065fb9eaa6fa tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1131.040479] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1131.040863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.040981] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.041078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.041258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.041407] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.041501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.041561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.041711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.041794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.041883] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.396261] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.396261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.396464] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.396915] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.396915] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.397118] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.397242] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.397459] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.397599] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.397840] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.397938] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.398123] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.398123] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.398231] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.398319] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.398480] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.419258] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.419483] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.419562] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.419746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-484" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.420081] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-15edad5b-2fac-44ac-9ae8-049580c5579b taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.420264] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.420480] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.420720] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.420916] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15edad5b-2fac-44ac-9ae8-049580c5579b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.543747] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.543747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.543906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.544114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.544214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.544416] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.544519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.544577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.544734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.544810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.544895] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1131.573098] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.573244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.573315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.573530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.573669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.583447] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1131.923563] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.923845] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.923937] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.924261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.924415] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.924570] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 15edad5b-2fac-44ac-9ae8-049580c5579b not found, creating... [ 1131.924875] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.925092] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.925219] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.925446] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.925584] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.925884] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.926084] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.926247] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.926480] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.926680] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.926836] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 15edad5b-2fac-44ac-9ae8-049580c5579b is going to be created. [ 1131.949688] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.949947] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.950026] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.950405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.950882] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.950882] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.499211] env[65353]: INFO networking_nsxv3.common.synchronization [None req-11e71835-4a86-4c84-9748-bbf015658238 None None] Enqueued Resource ID: c875baf0-06e6-4e26-be75-923a93466ff3 with Priority: HIGHEST for action port [ 1132.499985] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c875baf0-06e6-4e26-be75-923a93466ff3 with Priority: HIGHEST for action port [ 1132.501101] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c875baf0-06e6-4e26-be75-923a93466ff3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.501101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c875baf0-06e6-4e26-be75-923a93466ff3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.502425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c875baf0-06e6-4e26-be75-923a93466ff3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.502856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c875baf0-06e6-4e26-be75-923a93466ff3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.503091] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c875baf0-06e6-4e26-be75-923a93466ff3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.658765] env[65353]: INFO networking_nsxv3.common.synchronization [req-0bf8ef5a-fea0-43c3-a195-31369cfab25f req-3368ecd0-8807-4bab-8fd4-dcaee4a5a952 service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1132.658932] env[65353]: INFO networking_nsxv3.common.synchronization [req-0bf8ef5a-fea0-43c3-a195-31369cfab25f req-3368ecd0-8807-4bab-8fd4-dcaee4a5a952 service nova] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1132.659139] env[65353]: INFO networking_nsxv3.common.synchronization [req-0bf8ef5a-fea0-43c3-a195-31369cfab25f req-3368ecd0-8807-4bab-8fd4-dcaee4a5a952 service nova] Enqueued Resource ID: 15edad5b-2fac-44ac-9ae8-049580c5579b with Priority: HIGHEST for action port [ 1132.659593] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_rules [ 1132.659731] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1132.659828] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15edad5b-2fac-44ac-9ae8-049580c5579b with Priority: HIGHEST for action port [ 1132.660262] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.660431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.660517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.660760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.660866] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.661783] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.661948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.663346] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-15edad5b-2fac-44ac-9ae8-049580c5579b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.663346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.663346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.663541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.663541] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15edad5b-2fac-44ac-9ae8-049580c5579b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.006735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c875baf0-06e6-4e26-be75-923a93466ff3 [ 1133.006867] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.006956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.007047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.007365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.007475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.007580] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c875baf0-06e6-4e26-be75-923a93466ff3 already deleted. [ 1133.007661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c875baf0-06e6-4e26-be75-923a93466ff3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.170036] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15edad5b-2fac-44ac-9ae8-049580c5579b with status ACTIVE [ 1133.170995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.170995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.170995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.170995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.170995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.170995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.171254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.171254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.171254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.171327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.171496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.171628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.171660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.171774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.171840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.171923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15edad5b-2fac-44ac-9ae8-049580c5579b is going to be updated. [ 1133.173196] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.173284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.194255] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.194412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.194451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.194669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.194807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.194970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15edad5b-2fac-44ac-9ae8-049580c5579b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.594689] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1133.594689] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1133.595021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.595021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.595177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.595360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.595478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.595550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.595727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.595784] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.595870] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.098966] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.602009] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.846039] env[65353]: INFO networking_nsxv3.common.synchronization [None req-9d0f1cc2-a5f0-449b-b141-19a747ae90fd None None] Enqueued Resource ID: d894e87a-f41c-48c1-8609-1c9e30aa5379 with Priority: HIGHEST for action port [ 1134.846039] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d894e87a-f41c-48c1-8609-1c9e30aa5379 with Priority: HIGHEST for action port [ 1134.846039] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d894e87a-f41c-48c1-8609-1c9e30aa5379 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.846039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d894e87a-f41c-48c1-8609-1c9e30aa5379" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.846039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d894e87a-f41c-48c1-8609-1c9e30aa5379" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.846039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d894e87a-f41c-48c1-8609-1c9e30aa5379" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.846039] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d894e87a-f41c-48c1-8609-1c9e30aa5379',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.106023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.106198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.106282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.106525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.106633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.106740] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1135.145511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.145732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.145830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.146181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.146381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.163526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1135.349098] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d894e87a-f41c-48c1-8609-1c9e30aa5379 [ 1135.349337] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.349469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.349534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.349751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.350109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.350109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d894e87a-f41c-48c1-8609-1c9e30aa5379 already deleted. [ 1135.350109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d894e87a-f41c-48c1-8609-1c9e30aa5379" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.187284] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.187284] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.187284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.187284] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.690916] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.691105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.691197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.691364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.691533] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.691628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.691689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.692019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.692019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.692019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.692211] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.692269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.692269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.692408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.692538] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.692624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.692681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.692810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.692880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.692958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.693062] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.199028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9cd2d9-7e06-497a-a422-6b045be4a832: rpc.has_security_group_logging(os_id): False [ 1138.215764] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.215985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.216163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.216393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.216487] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.217149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.217149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.217149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.217149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.217149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.217481] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.217481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.217481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.217639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.217639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.218194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.218194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.218194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.218194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.218480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.218480] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1138.284106] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.284190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.284221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.284479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.284655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.302038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1138.552552] env[65353]: INFO networking_nsxv3.common.synchronization [req-27a97f87-8b13-4263-ab7e-2a2d8ef44781 req-35556d37-6fd0-409d-9002-32185127ac89 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1138.553099] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1138.553441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.553694] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.553770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.554042] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.554294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.554294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.554294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.554475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.554533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.554828] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.642089] env[65353]: INFO networking_nsxv3.common.synchronization [req-0d895e99-aaee-4c41-af9f-076e937054bc req-2a9d873a-39f5-4bca-a0e6-79fa4c0a3aac tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1138.642706] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1138.643647] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.643647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.643647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.643647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.643647] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.643906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.643906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.643906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.644048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.644087] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.930444] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.930695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.930834] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.931133] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.931392] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.931554] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.931668] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.931879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.932033] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.932304] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.932450] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.932561] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.932685] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.932818] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.932936] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.933186] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.953643] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.953808] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.953940] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.954129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-23" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.954442] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-28fab26f-b657-4c17-b845-4bf9909f83c1 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.954612] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.954728] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.955052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.955191] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28fab26f-b657-4c17-b845-4bf9909f83c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.057450] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.146405] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.146600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.146641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.146950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.147097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.147364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.147506] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.147593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.147780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.147888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.148070] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1139.174348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.174348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.174517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.174940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.174940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.183796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1139.459052] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.459052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.459052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.459052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.459052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.459052] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 28fab26f-b657-4c17-b845-4bf9909f83c1 not found, creating... [ 1139.459052] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.459052] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.459602] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.459602] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.459602] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.459744] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.459898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.460016] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.460231] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.460361] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.460497] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 28fab26f-b657-4c17-b845-4bf9909f83c1 is going to be created. [ 1139.481483] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.481697] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.481828] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.482111] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.482339] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.482554] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.560108] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.063341] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.063531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.063639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.064131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.064242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.064366] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1140.110251] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.110503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.110554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.110827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.111032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.121807] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1140.243024] env[65353]: INFO networking_nsxv3.common.synchronization [req-27a97f87-8b13-4263-ab7e-2a2d8ef44781 req-d5efc9bd-3aa9-4097-80d0-7d3ccd6f24c8 service nova] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 1140.243024] env[65353]: INFO networking_nsxv3.common.synchronization [req-27a97f87-8b13-4263-ab7e-2a2d8ef44781 req-d5efc9bd-3aa9-4097-80d0-7d3ccd6f24c8 service nova] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1140.243024] env[65353]: INFO networking_nsxv3.common.synchronization [req-27a97f87-8b13-4263-ab7e-2a2d8ef44781 req-d5efc9bd-3aa9-4097-80d0-7d3ccd6f24c8 service nova] Enqueued Resource ID: 28fab26f-b657-4c17-b845-4bf9909f83c1 with Priority: HIGHEST for action port [ 1140.243024] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_rules [ 1140.243024] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1140.243606] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28fab26f-b657-4c17-b845-4bf9909f83c1 with Priority: HIGHEST for action port [ 1140.244078] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.244350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.244516] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.247080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.247080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.247080] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.247080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.247080] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-28fab26f-b657-4c17-b845-4bf9909f83c1 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.247080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.247080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.247080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.247080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28fab26f-b657-4c17-b845-4bf9909f83c1',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.317076] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1140.317076] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.749935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.750351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.752669] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28fab26f-b657-4c17-b845-4bf9909f83c1 with status ACTIVE [ 1140.752910] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.753108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.753227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.754765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.754877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.755128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.755247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.755312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.755478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.755556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.755759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.755885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.755885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.756018] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.756116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.756193] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28fab26f-b657-4c17-b845-4bf9909f83c1 is going to be updated. [ 1140.780568] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.780715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.780786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.781045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.781133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.781280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28fab26f-b657-4c17-b845-4bf9909f83c1" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.795444] env[65353]: INFO networking_nsxv3.common.synchronization [req-80618b73-1d9b-4fee-8cb4-ea7a8b9bb977 req-e3ad8040-95aa-4129-a1d2-e671b08d557e tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1140.796015] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1140.796414] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.796553] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.796599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.796783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.796928] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.797036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.797094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.797242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.797326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.797416] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.188771] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.188969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.189106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.189371] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.189621] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.189773] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.189883] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.190295] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.190463] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.190667] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.190935] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.191095] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.191210] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.191332] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.191419] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.191547] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.194682] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1141.194841] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1141.194943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.209347] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.209451] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.209586] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.209927] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.210089] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.210260] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.210377] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.211290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.211563] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.300847] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.714409] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.714624] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.714747] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.715051] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.715225] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.715387] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd not found, creating... [ 1141.715691] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.715858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.716020] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.716325] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.716464] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.716740] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.716898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.717027] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.717329] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.717471] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.717610] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd is going to be created. [ 1141.738397] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.738687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.738854] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.739261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.739567] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.739806] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.802703] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.132906] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1142.133154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.133322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.133532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.133723] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.133837] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.133899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.134134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.134230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.134322] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.305343] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.308259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.308259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.308259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.308259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.308259] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1142.341403] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.341513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.341571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.342354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.342354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.355532] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1142.492084] env[65353]: INFO networking_nsxv3.common.synchronization [req-80618b73-1d9b-4fee-8cb4-ea7a8b9bb977 req-3c70577f-f12f-4125-8a75-0e912b7087b8 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1142.492314] env[65353]: INFO networking_nsxv3.common.synchronization [req-80618b73-1d9b-4fee-8cb4-ea7a8b9bb977 req-3c70577f-f12f-4125-8a75-0e912b7087b8 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1142.492483] env[65353]: INFO networking_nsxv3.common.synchronization [req-80618b73-1d9b-4fee-8cb4-ea7a8b9bb977 req-3c70577f-f12f-4125-8a75-0e912b7087b8 service nova] Enqueued Resource ID: cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd with Priority: HIGHEST for action port [ 1142.493190] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1142.493391] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1142.493501] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd with Priority: HIGHEST for action port [ 1142.493840] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.494099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.494199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.494469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.494469] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.496083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.496083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.496337] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.496481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.496592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.496767] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.496859] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.636062] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.999192] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.999505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.999615] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd with status ACTIVE [ 1142.999831] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.999979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.000080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.000424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.000605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.000719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.000793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.001088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001283] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.001377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.001437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.001647] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.001787] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001830] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd is going to be updated. [ 1143.027517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.027816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.027816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.028048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.028189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.028361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd54e5af-a888-4e5e-b52a-ba7c6c2b7afd" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.138364] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.168932] env[65353]: INFO networking_nsxv3.common.synchronization [req-63db609d-f2de-439d-a17d-2ac9da1f74d6 req-6496abad-bcab-4b2e-84e4-8eb3b952743f tempest-InstanceActionsNegativeTestJSON-764931127 tempest-InstanceActionsNegativeTestJSON-764931127-project-member] Enqueued Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1143.169441] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1143.169945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.170183] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.170237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.170519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.170714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.170769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.170845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.171012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.171102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.171196] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.511333] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.511546] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-98" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.511669] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-98" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.511995] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-98" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.512271] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.512423] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.512538] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.512755] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.512897] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.514081] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.514081] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.514081] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.514081] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.514081] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.514081] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.514365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.536859] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.537270] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.537498] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.537776] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-98" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.538122] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-a067c9b5-2930-4a69-8e33-4cca268f37a8 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.538304] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.538429] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.538744] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.538882] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a067c9b5-2930-4a69-8e33-4cca268f37a8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.640426] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.640630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.640703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.640915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.641015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.641240] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1143.672335] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.672335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.672335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.672524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.672653] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.673816] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.673929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.674034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.674363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.674464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.675074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.675074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.675074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.675074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.675074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.675307] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 already deleted. [ 1143.675307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.683363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1144.041968] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.042409] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.042409] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.042616] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.042772] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.042929] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port a067c9b5-2930-4a69-8e33-4cca268f37a8 not found, creating... [ 1144.043291] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.043735] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.044045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.044288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.044435] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.044938] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.045206] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.045371] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.045695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.045897] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.046209] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: a067c9b5-2930-4a69-8e33-4cca268f37a8 is going to be created. [ 1144.068296] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.068541] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.068663] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.068931] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.069167] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.069392] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.366982] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1144.367422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.367422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.367641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.367828] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.367947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.368019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.368184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.368238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.368335] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.787426] env[65353]: INFO networking_nsxv3.common.synchronization [req-63db609d-f2de-439d-a17d-2ac9da1f74d6 req-7def635d-6566-4bdb-bfe1-280b822c2efc service nova] Enqueued Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_rules [ 1144.787601] env[65353]: INFO networking_nsxv3.common.synchronization [req-63db609d-f2de-439d-a17d-2ac9da1f74d6 req-7def635d-6566-4bdb-bfe1-280b822c2efc service nova] Enqueued Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1144.787733] env[65353]: INFO networking_nsxv3.common.synchronization [req-63db609d-f2de-439d-a17d-2ac9da1f74d6 req-7def635d-6566-4bdb-bfe1-280b822c2efc service nova] Enqueued Resource ID: a067c9b5-2930-4a69-8e33-4cca268f37a8 with Priority: HIGHEST for action port [ 1144.788297] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_rules [ 1144.788455] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1144.788548] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a067c9b5-2930-4a69-8e33-4cca268f37a8 with Priority: HIGHEST for action port [ 1144.788827] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.788948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.789116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.789445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.789715] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.791383] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.791520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.791577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.791813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.792061] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.792210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.792318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.792576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.792711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.792870] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.795605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-a067c9b5-2930-4a69-8e33-4cca268f37a8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.795726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.795811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.795985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.796123] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a067c9b5-2930-4a69-8e33-4cca268f37a8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.870355] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.297974] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.299137] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.299317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.300299] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a067c9b5-2930-4a69-8e33-4cca268f37a8 with status ACTIVE [ 1145.300299] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.300299] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.300299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.300691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.300691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.300691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.300780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.300839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.300973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.301086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.301174] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a067c9b5-2930-4a69-8e33-4cca268f37a8 is going to be updated. [ 1145.330848] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.331065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.331065] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.331275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.331415] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.331771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a067c9b5-2930-4a69-8e33-4cca268f37a8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.372744] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.411577] env[65353]: INFO networking_nsxv3.common.synchronization [req-0e7d1bb3-0c2a-428c-90d3-d84fead0a8f3 req-c7575d54-9027-4d7f-8892-fdca278d4d09 tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1145.412210] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1145.412542] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.412695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.414149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.414149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.414149] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.694394] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1145.694394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.694394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.694394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.694394] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.694394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.694394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.694791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.694791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.694791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.694863] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.731560] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.731788] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.731974] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.732218] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.732938] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.732938] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.732938] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.732938] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.733107] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.733284] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.733397] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.733504] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.733610] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.733716] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.733821] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.733948] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.753759] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.753929] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.754095] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.754255] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-684" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.754575] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.754852] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.754913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.755221] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.755532] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f693e2a5-5a9c-4fa0-b9e4-be599d693b5c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.803997] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.875653] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.875850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.875910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.876257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.876363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.876477] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1145.909483] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.909655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.909721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.909964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.910133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.917802] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.917992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.917992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.918884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.918884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.918884] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.918884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.918884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.918884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.919163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.919163] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1145.923770] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1145.951517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.951760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.951760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.952014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.952145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.962694] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1146.197498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.260492] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.261176] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.261176] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.261403] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.261621] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.261930] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f693e2a5-5a9c-4fa0-b9e4-be599d693b5c not found, creating... [ 1146.262391] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.262641] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.262820] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.263225] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.263420] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.263891] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.264148] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.264323] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.264617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.264822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.265041] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f693e2a5-5a9c-4fa0-b9e4-be599d693b5c is going to be created. [ 1146.285957] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.286293] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.286483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.286757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.287015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.287374] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.308397] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.308820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.308820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.308967] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.309088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.309203] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 is going to be created. [ 1146.356016] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.356300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.356300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.356572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.356750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.381923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: UNINITIALIZED for 2s [ 1146.700494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e4cc2e-7db9-4ecb-adb0-1ff58af51797: rpc.has_security_group_logging(os_id): False [ 1146.719546] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.719686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.719755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.719973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.720079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.720330] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.720433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.720496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.720645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.720718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.720801] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1146.777331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.777331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.777551] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.777597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.777774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.797831] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1147.005410] env[65353]: INFO networking_nsxv3.common.synchronization [req-0e7d1bb3-0c2a-428c-90d3-d84fead0a8f3 req-d3131397-3d2f-4c45-85bf-77cedb546506 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1147.005572] env[65353]: INFO networking_nsxv3.common.synchronization [req-0e7d1bb3-0c2a-428c-90d3-d84fead0a8f3 req-d3131397-3d2f-4c45-85bf-77cedb546506 service nova] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1147.005701] env[65353]: INFO networking_nsxv3.common.synchronization [req-0e7d1bb3-0c2a-428c-90d3-d84fead0a8f3 req-d3131397-3d2f-4c45-85bf-77cedb546506 service nova] Enqueued Resource ID: f693e2a5-5a9c-4fa0-b9e4-be599d693b5c with Priority: HIGHEST for action port [ 1147.006276] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_rules [ 1147.006411] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1147.006506] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f693e2a5-5a9c-4fa0-b9e4-be599d693b5c with Priority: HIGHEST for action port [ 1147.006839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.007397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.007543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.007836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.007970] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.009987] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.010179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.010518] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.010683] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.010907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.011223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.012219] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f693e2a5-5a9c-4fa0-b9e4-be599d693b5c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.033097] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a13fad29-bb4b-4b09-89e3-1467be4afe2b tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1147.033598] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1147.033930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.034088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.034161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.034438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.034523] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.144628] env[65353]: INFO networking_nsxv3.common.synchronization [None req-13e47e78-5850-46e4-9f37-4af462b83706 tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1147.145402] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1147.145993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.146406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.339286] env[65353]: INFO networking_nsxv3.common.synchronization [req-3fc7f587-aedd-47ab-9db4-ab5b49128f01 req-61e47b8d-a7fd-45af-acc9-979e48239722 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1147.339859] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1147.340490] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.340702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.340702] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.341237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.341447] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.341562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.341623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.341785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.341871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.341981] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.518168] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.518316] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.518524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f693e2a5-5a9c-4fa0-b9e4-be599d693b5c with status ACTIVE [ 1147.518702] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.518806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.518864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.519096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.519242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.519358] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.519452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.519513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.519667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.519778] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.519992] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.520114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.520185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.520330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.520404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.520485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f693e2a5-5a9c-4fa0-b9e4-be599d693b5c is going to be updated. [ 1147.543210] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.543210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.543210] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.543390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.543434] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.543579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f693e2a5-5a9c-4fa0-b9e4-be599d693b5c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.555788] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.555970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.556525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.556525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.556525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.556660] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce already deleted. [ 1147.556660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.556793] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.556957] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.557047] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.843767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.843928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.844055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.844320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.844399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.844606] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.844707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.844794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.844956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.845046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.845136] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1147.877049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.877261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.877261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.877490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.877664] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.887584] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1147.933293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1147.933544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.933723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.933973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.935030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.935030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.935030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.935030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.935030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.935317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.935317] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.975274] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1147.975274] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1147.975274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.975680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.976654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.976875] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.979102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.979102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.979102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.979102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.979102] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.081886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.082283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.082283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.082404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.083373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.083373] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce already deleted. [ 1148.083373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.391910] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: SUCCESS [ 1148.392272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.392312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.392518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.392725] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.392836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.392900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.393070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.393152] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.393238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.393327] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.437112] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.437264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.437356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.437714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.437925] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.438048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.438113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.438286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.438365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.438557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.438676] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.438755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.438826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.438969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.439116] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.439209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.439324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.439394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.439469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.439548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.439634] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.480767] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.818020] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1148.818020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.895543] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.898962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.898962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.898962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.898962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.899665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.899665] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.941376] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1148.960994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.961177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.961218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.961470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.961598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.961823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.961933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.961994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.962164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.962249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.962476] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.962591] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.962657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.962802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.962878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.963069] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.963164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.963225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.963361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.963433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.963516] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1148.984823] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.024277] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.024419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.024419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.024583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.024731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.040679] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1149.401902] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a15abaf-4694-449c-9040-c4b1acb179c0: rpc.has_security_group_logging(os_id): False [ 1149.423044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.423212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.423308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.423468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.423568] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.423803] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.423914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.423973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.424177] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.424247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.424440] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.424531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.424595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.424723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.424790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.424972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.425074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.425121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.425258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.425328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.425450] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 is going to be created. [ 1149.486805] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.487014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.487104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.487477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.487755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.487755] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1149.489927] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.490085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.490196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.490374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.490628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.514745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: IN_PROGRESS for 2s [ 1149.565276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.565454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.565525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.565744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.565905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.577216] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1149.911474] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1149.911645] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff deletion is rescheduled due to dependency. [ 1149.911848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.055283] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1151.055532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.527403] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: SUCCESS [ 1151.527403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.588398] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1151.588398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.588633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.588791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.589229] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.589229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.589356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.589498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.590810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.590810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.590810] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.092668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.092971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.092971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.093389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.093389] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.093389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.093585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.093636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.093686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.093786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.093955] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.094135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.094489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.094489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.094591] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.094640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.094674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.094823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.094865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.094930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.095026] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.340556] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.340717] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1152.597218] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee283bce-4b1f-47a4-b9bc-1f0367034344: rpc.has_security_group_logging(os_id): False [ 1152.615531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.615669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.615736] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.615944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.616047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.616338] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.616464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.616517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.616643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.616715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.616886] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.616979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.617051] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.617243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.617336] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.617960] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.617960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.617960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.617960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.617960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.617960] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1152.683839] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.683839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.683839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.683839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.683839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.699490] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1152.903935] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.904283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.904499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.904838] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.905235] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.905419] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.905538] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.905770] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.905920] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.906162] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.906377] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.906485] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.906642] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.906772] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.906876] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.907024] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.930051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.930230] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.930371] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.930550] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-407" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.930868] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.931054] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.931254] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.931483] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.931633] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ba09fd-b87d-4995-8b24-3e93e0b6a2cc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.328260] env[65353]: INFO networking_nsxv3.common.synchronization [req-6fb2132b-f6b2-4c39-a5c0-7e8b7ecbec35 req-36b605e3-b2ea-4b47-a8d5-c056d179205d tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1153.328874] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGHEST for action security_group_members [ 1153.329271] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.329422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.329422] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.329654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.329834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.329944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.330033] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.330176] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.330265] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.330359] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.433989] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.434973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.434973] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.435168] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.435321] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.435633] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.435796] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.435914] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.436171] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.436367] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.436858] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.437054] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.437185] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.437505] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.437664] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.437824] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc is going to be updated. [ 1153.460374] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.460643] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.460736] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.461037] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.461241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.461462] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.832639] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.832826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.832863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.833122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.853307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.853569] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.853759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.853759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.853988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.854077] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.854186] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb is going to be updated. [ 1153.882821] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.882992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.883136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.883272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.883464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.894228] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: IN_PROGRESS for 2s [ 1154.188647] env[65353]: INFO networking_nsxv3.common.synchronization [req-667570d5-5dee-4c43-be6f-5d633547e116 req-c1fe2383-f7ad-41d1-87bc-e3954070a779 service nova] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1154.188823] env[65353]: INFO networking_nsxv3.common.synchronization [req-667570d5-5dee-4c43-be6f-5d633547e116 req-c1fe2383-f7ad-41d1-87bc-e3954070a779 service nova] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1154.188968] env[65353]: INFO networking_nsxv3.common.synchronization [req-667570d5-5dee-4c43-be6f-5d633547e116 req-c1fe2383-f7ad-41d1-87bc-e3954070a779 service nova] Enqueued Resource ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with Priority: HIGHEST for action port [ 1154.189562] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_rules [ 1154.189717] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1154.189778] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with Priority: HIGHEST for action port [ 1154.190082] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.190216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.190278] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.190495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.190578] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.191511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.191692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.191692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.191964] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.191997] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.192170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.192170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.192301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.192396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.192487] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.194217] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.194314] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.194382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.194543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.194619] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88ba09fd-b87d-4995-8b24-3e93e0b6a2cc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.695414] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.697893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.697893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.697893] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc with status ACTIVE [ 1154.697893] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.698133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.698193] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.698411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.698501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.698667] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.698761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.699047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.699047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.699113] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.699730] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.699730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.699730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.699730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.699730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.699730] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88ba09fd-b87d-4995-8b24-3e93e0b6a2cc is going to be updated. [ 1154.715174] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1154.715393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.726031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.726031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.726031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.726031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.726031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.726372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88ba09fd-b87d-4995-8b24-3e93e0b6a2cc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.198118] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.700945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.701443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.701443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.701548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.701732] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.701882] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be updated. [ 1155.734596] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.734757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.734816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.735013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.735167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.745449] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: IN_PROGRESS for 2s [ 1155.907678] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56622075-2f39-4c3e-86af-b1c6fc510beb in Status: SUCCESS [ 1155.907928] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb deletion is rescheduled due to dependency. [ 1155.907928] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.756494] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: SUCCESS [ 1157.756860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.756901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.757118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.757323] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.757457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.757523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.757691] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.757774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.757860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.757949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.260251] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.540164] env[65353]: INFO networking_nsxv3.common.synchronization [req-cdfad902-9d65-4c66-9de0-16568f9c318b req-0009c950-e5d9-4549-85c7-188a2cd40099 tempest-InstanceActionsNegativeTestJSON-764931127 tempest-InstanceActionsNegativeTestJSON-764931127-project-member] Enqueued Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1158.540807] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGHEST for action security_group_members [ 1158.541221] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.541765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.541848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.542109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.542314] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.542401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.542458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.542649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.542727] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.542849] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.764054] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a38562f5-e69e-466a-80a0-67c20329559a: rpc.has_security_group_logging(os_id): False [ 1158.784319] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.784488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.784526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.784756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.784854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.785109] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.785211] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.785269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.785425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.785490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.785597] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be updated. [ 1158.845605] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.845764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.845833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.846024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.846173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.858204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: IN_PROGRESS for 2s [ 1159.045120] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.045298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.045440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.045701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.045845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.046099] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.046280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.046338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.046507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.046585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.046675] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 is going to be updated. [ 1159.089989] env[65353]: INFO networking_nsxv3.common.synchronization [req-dbdc7a7a-7ab8-4c7b-8c21-b24a3f8e3d42 req-a0d444ce-395e-407d-b668-41f4724de70f tempest-ServerDiskConfigTestJSON-638867047 tempest-ServerDiskConfigTestJSON-638867047-project-member] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1159.090801] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGHEST for action security_group_members [ 1159.091321] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.091548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.091670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.092017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.093400] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.093400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.093400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.093400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.093400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.093400] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.100045] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.100045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.100045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.100045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.100325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.113297] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: IN_PROGRESS for 2s [ 1159.344666] env[65353]: INFO networking_nsxv3.common.synchronization [req-8ccd8586-3283-4ce4-a2e1-3f563095e81d req-ef2494aa-529e-4f9d-a77f-7eed5d85c8ed tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1159.345301] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1159.345669] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.345804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.345886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.346157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.346490] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.346490] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.346690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.346749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.346834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.346940] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.599029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.599254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.599768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.600013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.600172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.600908] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.600908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.600908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.600908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.600908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.601167] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be updated. [ 1159.648916] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.648916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.648916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.648916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.648916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.663634] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.663831] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.663951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.664243] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.664473] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.664623] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.664731] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.664954] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.665119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.665366] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.665480] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.665591] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.665692] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.665794] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.665894] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.666025] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.667732] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: IN_PROGRESS for 2s [ 1159.688916] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.689149] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.689229] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.689394] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.689706] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-d8e482fa-563c-4ab6-ab28-b8340511cccc taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.689926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.689998] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.690375] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.690512] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e482fa-563c-4ab6-ab28-b8340511cccc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.849072] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.849652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.849652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.849652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.849652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.849869] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.850067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.850067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.850243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.850354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.850456] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce already deleted. [ 1159.850554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.193266] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.193529] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.193662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.193951] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.194112] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.194307] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port d8e482fa-563c-4ab6-ab28-b8340511cccc not found, creating... [ 1160.194638] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.194808] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.194924] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.195187] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.195325] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.195620] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.195791] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.195909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.196349] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.196506] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.196646] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: d8e482fa-563c-4ab6-ab28-b8340511cccc is going to be created. [ 1160.218773] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.218987] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.219123] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.219460] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.219690] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.219922] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.886063] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: SUCCESS [ 1160.886417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.984029] env[65353]: INFO networking_nsxv3.common.synchronization [req-8ccd8586-3283-4ce4-a2e1-3f563095e81d req-7f7e4362-6361-49f9-921d-2d3fc9bb49dd service nova] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1160.984228] env[65353]: INFO networking_nsxv3.common.synchronization [req-8ccd8586-3283-4ce4-a2e1-3f563095e81d req-7f7e4362-6361-49f9-921d-2d3fc9bb49dd service nova] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1160.984393] env[65353]: INFO networking_nsxv3.common.synchronization [req-8ccd8586-3283-4ce4-a2e1-3f563095e81d req-7f7e4362-6361-49f9-921d-2d3fc9bb49dd service nova] Enqueued Resource ID: d8e482fa-563c-4ab6-ab28-b8340511cccc with Priority: HIGHEST for action port [ 1160.984699] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_rules [ 1160.984828] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1160.984922] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e482fa-563c-4ab6-ab28-b8340511cccc with Priority: HIGHEST for action port [ 1160.986017] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.986017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.986017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.986234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.986263] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.990408] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.990408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.990408] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.990660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.990660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.990768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.990768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.990877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.991268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.991268] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.993254] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e482fa-563c-4ab6-ab28-b8340511cccc taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.993254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.993254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.993254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.993450] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e482fa-563c-4ab6-ab28-b8340511cccc',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.122984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 in Status: SUCCESS [ 1161.123240] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 deletion is rescheduled due to dependency. [ 1161.123573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.490858] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.491199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.496695] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8e482fa-563c-4ab6-ab28-b8340511cccc with status ACTIVE [ 1161.496920] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.497082] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.497166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.497511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.497511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.497713] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.497834] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.497906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.498094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.498171] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.498374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.498511] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.498548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.498705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.498774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.498884] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8e482fa-563c-4ab6-ab28-b8340511cccc is going to be updated. [ 1161.500081] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.527036] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.527262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.527262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.527560] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.527769] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.527966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e482fa-563c-4ab6-ab28-b8340511cccc" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.677546] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 in Status: SUCCESS [ 1161.677736] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 deletion is rescheduled due to dependency. [ 1161.677891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.003561] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.505963] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.506157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.506230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.506558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.506656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.506766] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce is going to be created. [ 1162.544115] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.544345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.544345] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.544561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.544756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.556169] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: UNINITIALIZED for 2s [ 1163.963435] env[65353]: INFO networking_nsxv3.common.synchronization [req-a9052f3d-9325-4358-8677-bb2c04597524 req-08ea45d3-3433-4152-993e-acfa65173f21 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1163.964562] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1163.964982] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.965139] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.965190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.965384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.965564] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.965667] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.965764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.965950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.966059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.966143] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.305154] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.305387] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.305485] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.305966] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.306321] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.306592] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.306727] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.306981] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.307150] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.307413] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.307558] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.307682] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.307879] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.307919] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.308041] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.308183] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.331049] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.331278] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.331460] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.331630] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.331955] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-692f6ac9-3041-43bf-919f-aa5c55fe29a3 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.332152] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.332256] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.332656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.332841] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692f6ac9-3041-43bf-919f-aa5c55fe29a3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.468866] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.569016] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: SUCCESS [ 1164.569426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.570123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.570358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.570733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.570860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.570969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.571224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.571428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.571621] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.571793] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.835835] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.836230] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.836425] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.836733] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.836886] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.837097] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 692f6ac9-3041-43bf-919f-aa5c55fe29a3 not found, creating... [ 1164.837568] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.837568] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.837706] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.837954] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.838045] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.838340] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.838519] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.838635] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.838931] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.839131] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.839293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 692f6ac9-3041-43bf-919f-aa5c55fe29a3 is going to be created. [ 1164.861939] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.862166] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.862217] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.862499] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.862757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.862941] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.971096] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.074225] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.473487] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.473688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.473822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.474156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.474264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.474521] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1165.510924] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.511114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.511163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.511362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.511512] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.526472] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1165.576983] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2996eed-d1f2-4333-a319-97d66b50fdce: rpc.has_security_group_logging(os_id): False [ 1165.598459] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.598459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.598459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.598926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.599777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.599777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.599777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.599777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.600583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.600583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.600583] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce is going to be created. [ 1165.623178] env[65353]: INFO networking_nsxv3.common.synchronization [req-a9052f3d-9325-4358-8677-bb2c04597524 req-68528c65-4ee2-4e1c-b2a7-37b25f4e1df9 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1165.623474] env[65353]: INFO networking_nsxv3.common.synchronization [req-a9052f3d-9325-4358-8677-bb2c04597524 req-68528c65-4ee2-4e1c-b2a7-37b25f4e1df9 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1165.623704] env[65353]: INFO networking_nsxv3.common.synchronization [req-a9052f3d-9325-4358-8677-bb2c04597524 req-68528c65-4ee2-4e1c-b2a7-37b25f4e1df9 service nova] Enqueued Resource ID: 692f6ac9-3041-43bf-919f-aa5c55fe29a3 with Priority: HIGHEST for action port [ 1165.624872] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1165.625152] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1165.625359] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 692f6ac9-3041-43bf-919f-aa5c55fe29a3 with Priority: HIGHEST for action port [ 1165.625869] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.626117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.626269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.626642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.626856] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.629028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.629146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.629489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-692f6ac9-3041-43bf-919f-aa5c55fe29a3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.629601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.629601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.629820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.629903] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692f6ac9-3041-43bf-919f-aa5c55fe29a3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.668761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.669025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.669025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.669214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.669374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.680415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: IN_PROGRESS for 2s [ 1166.130622] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.130622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.132239] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 692f6ac9-3041-43bf-919f-aa5c55fe29a3 with status ACTIVE [ 1166.132239] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.132239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.132239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.133098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.133098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.133098] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.133098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.133098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.133242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.133292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.133509] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.133682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.133682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.133993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.134095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.135084] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 692f6ac9-3041-43bf-919f-aa5c55fe29a3 is going to be updated. [ 1166.157608] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.157785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.157825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.158118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.158317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.158455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-692f6ac9-3041-43bf-919f-aa5c55fe29a3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.728644] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0050ea29-7c7e-498a-9abb-be6f3fef7547 tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1166.729208] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1166.729522] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.729644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.729711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.729985] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.730364] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.845257] env[65353]: INFO networking_nsxv3.common.synchronization [None req-e4b83972-22e5-4fec-b6fe-5192f56209e8 tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1166.845778] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1166.846099] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.846204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.255332] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.255662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.255662] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.255770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.255853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.255946] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 already deleted. [ 1167.256050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.256206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.256436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.256539] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.538418] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1167.538800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.539127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.539402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.539714] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.539864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.539934] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.540178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.540271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.540373] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.694154] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: SUCCESS [ 1167.695012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.780032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.780032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.780032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.780032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.780308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.780308] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 already deleted. [ 1167.780308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.043259] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.241549] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ab6eda8-03c4-4897-8f7f-3d5427c3198b req-610e5383-41fb-40fc-80b1-495de80223e0 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1168.242120] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1168.242120] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.242120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.242275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.242714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.242890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.242996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.243071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.243763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.243763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.243763] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.543195] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.543632] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.543632] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.543777] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.544045] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.544205] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.544366] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.544539] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.544685] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.544904] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.545035] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.545149] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.545276] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.545389] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.545494] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.545622] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.549390] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.564716] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.564897] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.565049] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.565236] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.565757] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-aee310ba-91ab-43b9-9656-f6b6a4ac126e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.565757] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.565931] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.566247] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.566428] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee310ba-91ab-43b9-9656-f6b6a4ac126e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.745935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.746159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.746234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.746577] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.746687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.746936] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.747068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.747128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.747292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.747383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.747516] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1168.775048] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.775241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.775290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.775546] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.775723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.785038] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1169.052373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.052373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.052373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.052655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.052790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.052931] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1169.069269] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.069269] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.069591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.069730] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.069921] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.070108] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port aee310ba-91ab-43b9-9656-f6b6a4ac126e not found, creating... [ 1169.070384] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.070546] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.070689] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.070955] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.071123] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.071418] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.071577] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.071691] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.071938] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.072147] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.072326] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e is going to be created. [ 1169.098791] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.098791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.098992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.099234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.099497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.115529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1169.119738] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.120025] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.120143] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.120438] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.120679] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.120910] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.793398] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ab6eda8-03c4-4897-8f7f-3d5427c3198b req-6b8aa39d-7304-4f39-9f7b-eb9ab8b93568 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1169.793674] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ab6eda8-03c4-4897-8f7f-3d5427c3198b req-6b8aa39d-7304-4f39-9f7b-eb9ab8b93568 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1169.793711] env[65353]: INFO networking_nsxv3.common.synchronization [req-3ab6eda8-03c4-4897-8f7f-3d5427c3198b req-6b8aa39d-7304-4f39-9f7b-eb9ab8b93568 service nova] Enqueued Resource ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e with Priority: HIGHEST for action port [ 1169.794279] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1169.794434] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1169.794541] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e with Priority: HIGHEST for action port [ 1169.794824] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.794945] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.795017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.797623] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.797802] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.799335] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.799510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.799922] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee310ba-91ab-43b9-9656-f6b6a4ac126e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.800141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.800295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.800582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.800694] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee310ba-91ab-43b9-9656-f6b6a4ac126e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.304159] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.304390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.304721] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aee310ba-91ab-43b9-9656-f6b6a4ac126e with status ACTIVE [ 1170.305011] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.305169] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.305318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.305597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.305790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.305997] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.306156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.306241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.306478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.306633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.306864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.307021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.307142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.307266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.307361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.307522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e is going to be updated. [ 1170.334571] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.334794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.334794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.335059] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.335239] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.335419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.795260] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1170.795612] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff deletion is rescheduled due to dependency. [ 1170.795612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.795807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.796049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.796242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.796398] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.796481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.796640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.796723] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.796822] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.126735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.128949] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.128949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.128949] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.299366] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.633772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.633772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.633772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.633772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.633772] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.634032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.634032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.634097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.634208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.634258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.634445] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.634554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.634611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.634744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.634875] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.634955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.635017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.635200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.635275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.635381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.635481] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.802078] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.138363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1172.156349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.156349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.156541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.156817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.156923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.157185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.157295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.157354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.157593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.157672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.158331] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.158331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.158331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.158331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.158331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.158566] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.158566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.158566] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.158673] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.158706] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.158820] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1172.218582] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.218910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.219015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.219292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.219545] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.235568] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1172.306757] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.307841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.307971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.308218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.308315] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.308419] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1172.365223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.365461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.365536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.365798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.366027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.374440] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1174.189087] env[65353]: INFO networking_nsxv3.common.synchronization [None req-74487484-3539-4f21-b192-f55198c76ac8 None None] Enqueued Resource ID: 6814dc9e-bf7f-4155-a181-45cb8ff31e55 with Priority: HIGHEST for action port [ 1174.189948] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6814dc9e-bf7f-4155-a181-45cb8ff31e55 with Priority: HIGHEST for action port [ 1174.189948] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6814dc9e-bf7f-4155-a181-45cb8ff31e55 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.191639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6814dc9e-bf7f-4155-a181-45cb8ff31e55" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.191639] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6814dc9e-bf7f-4155-a181-45cb8ff31e55" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.192917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6814dc9e-bf7f-4155-a181-45cb8ff31e55" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.192917] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6814dc9e-bf7f-4155-a181-45cb8ff31e55',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.251536] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1174.251536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.386896] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1174.387095] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.387275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.387859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.388063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.388184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.388252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.388669] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.388782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.388918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.389043] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.695207] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6814dc9e-bf7f-4155-a181-45cb8ff31e55 [ 1174.695207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.695207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.695207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.695520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.695520] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.697031] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6814dc9e-bf7f-4155-a181-45cb8ff31e55 already deleted. [ 1174.697031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6814dc9e-bf7f-4155-a181-45cb8ff31e55" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.892517] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.394479] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff: rpc.has_security_group_logging(os_id): False [ 1175.415485] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.415641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.415730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.416080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.416080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.416298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.416391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.416526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.416660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.416711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.416795] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1175.503558] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.503558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.503741] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.504919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.505088] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.522904] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1176.330282] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f8dd96af-c19f-4729-9240-2e5b8aed2b5c None None] Enqueued Resource ID: db9a4451-fe35-40a2-b3bc-1c87c34122ca with Priority: HIGHEST for action port [ 1176.330468] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9a4451-fe35-40a2-b3bc-1c87c34122ca with Priority: HIGHEST for action port [ 1176.330640] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9a4451-fe35-40a2-b3bc-1c87c34122ca taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.330764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9a4451-fe35-40a2-b3bc-1c87c34122ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.330835] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9a4451-fe35-40a2-b3bc-1c87c34122ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.331125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9a4451-fe35-40a2-b3bc-1c87c34122ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.331226] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9a4451-fe35-40a2-b3bc-1c87c34122ca',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.629482] env[65353]: INFO networking_nsxv3.common.synchronization [None req-4ad4c451-f53c-4447-8b61-78d0e8022b4d None None] Enqueued Resource ID: 6e7398cb-4917-4ca1-977e-14df5205d8c2 with Priority: HIGHEST for action port [ 1176.630448] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7398cb-4917-4ca1-977e-14df5205d8c2 with Priority: HIGHEST for action port [ 1176.630448] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e7398cb-4917-4ca1-977e-14df5205d8c2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.630448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e7398cb-4917-4ca1-977e-14df5205d8c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.630448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e7398cb-4917-4ca1-977e-14df5205d8c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.630832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e7398cb-4917-4ca1-977e-14df5205d8c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.630832] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7398cb-4917-4ca1-977e-14df5205d8c2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.834743] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9a4451-fe35-40a2-b3bc-1c87c34122ca [ 1176.836035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.836035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.836035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.836035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.836035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.836035] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9a4451-fe35-40a2-b3bc-1c87c34122ca already deleted. [ 1176.836035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9a4451-fe35-40a2-b3bc-1c87c34122ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.132698] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e7398cb-4917-4ca1-977e-14df5205d8c2 [ 1177.132937] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.133097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.133170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.133392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.133484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.133583] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e7398cb-4917-4ca1-977e-14df5205d8c2 already deleted. [ 1177.133677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e7398cb-4917-4ca1-977e-14df5205d8c2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.556231] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1177.556231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.579861] env[65353]: INFO networking_nsxv3.common.synchronization [req-f0db77c5-f621-4dbd-a5a9-c8959f6d1c24 req-8d698bdc-7cef-4a3e-b6b4-038b6e0bf699 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1177.580390] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1177.580777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.582196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.582196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.582330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.582520] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.582637] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.582703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.582874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.582965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.583075] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.086114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.589070] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.660403] env[65353]: INFO networking_nsxv3.common.synchronization [None req-6bbfad78-2d77-4ac7-b769-8f40d633d8c3 None None] Enqueued Resource ID: b27d0d99-bc02-49ed-9782-31e74d167da2 with Priority: HIGHEST for action port [ 1178.660612] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27d0d99-bc02-49ed-9782-31e74d167da2 with Priority: HIGHEST for action port [ 1178.660942] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-b27d0d99-bc02-49ed-9782-31e74d167da2 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.661063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b27d0d99-bc02-49ed-9782-31e74d167da2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.661131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b27d0d99-bc02-49ed-9782-31e74d167da2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.661383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b27d0d99-bc02-49ed-9782-31e74d167da2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.661466] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b27d0d99-bc02-49ed-9782-31e74d167da2',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.091835] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.092203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.092203] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.092360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.092461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.092561] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1179.123946] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.124096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.124192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.124361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.125019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.133302] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1179.163751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b27d0d99-bc02-49ed-9782-31e74d167da2 [ 1179.164171] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.164271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.164308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.164585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.164711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.164778] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b27d0d99-bc02-49ed-9782-31e74d167da2 already deleted. [ 1179.165145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b27d0d99-bc02-49ed-9782-31e74d167da2" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.481076] env[65353]: INFO networking_nsxv3.common.synchronization [req-b428c182-6905-4b06-8a05-a96228fc2f8e req-ee535ce0-b81a-44c6-990d-8845af0521e5 tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1179.481760] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1179.482112] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.482263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.482295] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.482543] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.482729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.482796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.482870] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.483040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.483125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.483220] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.830567] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-760 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.830721] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.831521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.831521] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.831521] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.831694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.831694] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.831890] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.832057] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.832269] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.832374] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.832476] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.832576] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.832676] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.832774] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.832900] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.859208] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.859379] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.859507] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.859682] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-760" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.859999] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-493c615d-1ed1-4710-8383-4bddbc47781d taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.860183] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.860290] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.860754] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.860908] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493c615d-1ed1-4710-8383-4bddbc47781d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.985555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.985959] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.986048] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.986283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.986368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.986617] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.986737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.986785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.986936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.987027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.987110] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 already deleted. [ 1179.987187] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.364740] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.364740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.364740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.364740] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.365416] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.365416] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 493c615d-1ed1-4710-8383-4bddbc47781d not found, creating... [ 1180.365416] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.365416] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.365662] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.365696] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.365842] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.366143] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.366298] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.366410] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.366848] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.367011] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.367162] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 493c615d-1ed1-4710-8383-4bddbc47781d is going to be created. [ 1180.388541] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.388763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.388911] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.389223] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.389457] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.389681] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.889824] env[65353]: INFO networking_nsxv3.common.synchronization [req-0bbf4a1f-3203-406a-a27a-3099675b689b req-b535f5bb-1eed-4d2a-b54c-6d4135a744f3 tempest-DeleteServersTestJSON-850757218 tempest-DeleteServersTestJSON-850757218-project-member] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1180.890495] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGHEST for action security_group_members [ 1180.890753] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.890922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.891017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.891224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.891391] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.891489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.891594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.891707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.891804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.892022] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.130585] env[65353]: INFO networking_nsxv3.common.synchronization [req-b428c182-6905-4b06-8a05-a96228fc2f8e req-8c520fbd-8039-4520-99bc-0a75cfcf93cc service nova] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1181.130772] env[65353]: INFO networking_nsxv3.common.synchronization [req-b428c182-6905-4b06-8a05-a96228fc2f8e req-8c520fbd-8039-4520-99bc-0a75cfcf93cc service nova] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1181.130929] env[65353]: INFO networking_nsxv3.common.synchronization [req-b428c182-6905-4b06-8a05-a96228fc2f8e req-8c520fbd-8039-4520-99bc-0a75cfcf93cc service nova] Enqueued Resource ID: 493c615d-1ed1-4710-8383-4bddbc47781d with Priority: HIGHEST for action port [ 1181.131155] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_rules [ 1181.131282] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1181.131414] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493c615d-1ed1-4710-8383-4bddbc47781d with Priority: HIGHEST for action port [ 1181.132264] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.132390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.132457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.132658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.132741] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.133609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.133917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.133988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.134172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.134322] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.134442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.134505] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.134642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.134726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.134812] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.135548] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-493c615d-1ed1-4710-8383-4bddbc47781d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.135661] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.135715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.135857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.135930] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493c615d-1ed1-4710-8383-4bddbc47781d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.147417] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1181.147649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.394601] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.394884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.394884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.395078] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.395174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.395374] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.395473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.395536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.395686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.395761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.395847] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be updated. [ 1181.424973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.424973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.425141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.425455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.425905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.435255] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: IN_PROGRESS for 2s [ 1181.637384] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.638453] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.638576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.638946] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 493c615d-1ed1-4710-8383-4bddbc47781d with status ACTIVE [ 1181.639126] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.639240] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.639303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.639550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.639599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.639733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.639832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.639886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.640047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.640125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.640302] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.640391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.640450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.640628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.640659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.640726] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 493c615d-1ed1-4710-8383-4bddbc47781d is going to be updated. [ 1181.663396] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.664106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.664106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.664106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.664106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.664106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-493c615d-1ed1-4710-8383-4bddbc47781d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.842589] env[65353]: INFO networking_nsxv3.common.synchronization [req-f02ed4e9-5a54-447a-bbdb-7a9da22d2692 req-6cb3ae0a-e137-45e7-b5d0-557936820802 tempest-ServersNegativeTestMultiTenantJSON-1703929549 tempest-ServersNegativeTestMultiTenantJSON-1703929549-project-member] Enqueued Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1181.842915] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1181.843669] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.843890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.843988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.844299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.844537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.844663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.844748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.844960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.845117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.845332] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.139433] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.305119] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.305119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-512" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.305119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-512" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.305119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-512" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.305119] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.305645] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.305923] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.306595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.308119] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.308119] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.308119] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.308119] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.308119] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.308119] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.308119] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.308119] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.329387] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.329803] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.330053] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.330721] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-512" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.331127] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f9c05683-cfd1-4627-83b8-510dda9a4486 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.331378] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.331673] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.332081] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.332285] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9c05683-cfd1-4627-83b8-510dda9a4486',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.347675] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.347856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.347908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.348126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.348237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.348433] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.348531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.348585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.348755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.348821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.348968] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa already deleted. [ 1182.349153] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.644380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.644719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.644719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.644829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.644920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.645030] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 is going to be created. [ 1182.691236] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.691469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.691469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.691642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.691863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.701993] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: UNINITIALIZED for 2s [ 1182.834765] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.834981] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.835092] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.835390] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.835551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.835710] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f9c05683-cfd1-4627-83b8-510dda9a4486 not found, creating... [ 1182.835980] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.836229] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.836424] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.836710] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.836858] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.837182] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.837333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.837450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.837675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.837803] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.837944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f9c05683-cfd1-4627-83b8-510dda9a4486 is going to be created. [ 1182.875434] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.875434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.875557] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.875815] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.876061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.876357] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.448640] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 in Status: SUCCESS [ 1183.448640] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 deletion is rescheduled due to dependency. [ 1183.448640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.595122] env[65353]: INFO networking_nsxv3.common.synchronization [req-f02ed4e9-5a54-447a-bbdb-7a9da22d2692 req-d75406ce-8b71-4e9c-b48e-66a369a2b1e9 service nova] Enqueued Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_rules [ 1183.595122] env[65353]: INFO networking_nsxv3.common.synchronization [req-f02ed4e9-5a54-447a-bbdb-7a9da22d2692 req-d75406ce-8b71-4e9c-b48e-66a369a2b1e9 service nova] Enqueued Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1183.595122] env[65353]: INFO networking_nsxv3.common.synchronization [req-f02ed4e9-5a54-447a-bbdb-7a9da22d2692 req-d75406ce-8b71-4e9c-b48e-66a369a2b1e9 service nova] Enqueued Resource ID: f9c05683-cfd1-4627-83b8-510dda9a4486 with Priority: HIGHEST for action port [ 1183.595636] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_rules [ 1183.595758] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1183.596149] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c05683-cfd1-4627-83b8-510dda9a4486 with Priority: HIGHEST for action port [ 1183.596370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.596471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.596600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.597038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.597173] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.599074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.599074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.599074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.599074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.599297] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.599297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.599373] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.599645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.599645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.599783] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.600863] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9c05683-cfd1-4627-83b8-510dda9a4486 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.601040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.601162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.601501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.601501] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9c05683-cfd1-4627-83b8-510dda9a4486',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.103768] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.104174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.104248] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.105305] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9c05683-cfd1-4627-83b8-510dda9a4486 with status ACTIVE [ 1184.105489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.105602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.105666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.105862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.105949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.106124] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.106219] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.106281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.106426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.106499] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.106778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.106908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.106976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.107156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.107227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.107310] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9c05683-cfd1-4627-83b8-510dda9a4486 is going to be updated. [ 1184.131209] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.131428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.131428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.131616] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.131750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.131913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9c05683-cfd1-4627-83b8-510dda9a4486" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.609321] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.716493] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: SUCCESS [ 1184.716735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.717027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.717382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.717681] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.717874] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.718032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.718267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.718392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.718524] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.718664] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.112260] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.112666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.112666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.113654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.113654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.113654] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa is going to be created. [ 1185.158074] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.158250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.158369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.158536] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.158704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.170685] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: UNINITIALIZED for 2s [ 1185.221250] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.723918] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb5d077-5aae-475f-9ce6-a007397ccf52: rpc.has_security_group_logging(os_id): False [ 1185.745489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.745489] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.745489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.746189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.746189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.746189] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 is going to be created. [ 1185.845062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.845062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.845062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.845346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.845485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.860363] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: IN_PROGRESS for 2s [ 1186.278207] env[65353]: INFO networking_nsxv3.common.synchronization [req-8412faae-f6bd-4e6f-a7ff-007f315e27ce req-2a0ad062-0cf5-4d5c-8fa5-3da0ada540d9 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1186.279044] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1186.279044] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.279252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.279252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.279375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.279525] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.279756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.279756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.279975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.279975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.279975] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.784240] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.181909] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: SUCCESS [ 1187.182156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.182322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.182534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.183128] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.183128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.183128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.183128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.183128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.183386] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.183386] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.286130] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.685684] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.685997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.687047] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.687292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.687503] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.687625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.687931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.688030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.689032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.689032] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.689032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.690256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.690256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.690256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.690256] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.789149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.789149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.789361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.789570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.789570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.789669] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1187.821601] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.821899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.821899] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.822039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.822166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.834199] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1187.873975] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: SUCCESS [ 1187.874238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.192045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa: rpc.has_security_group_logging(os_id): False [ 1188.234740] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.234927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.235142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.235456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.235612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.235861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.235982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.236052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.236275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.236395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.236687] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.236808] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.236846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.236983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.237058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.237274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.237380] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.237453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.237631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.237715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.237848] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa is going to be created. [ 1188.312567] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.313695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.313695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.313695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.313695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.323491] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: IN_PROGRESS for 2s [ 1189.851219] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1189.851599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.335840] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: SUCCESS [ 1190.336092] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.279917] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1191.280229] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1195.255952] env[65353]: INFO networking_nsxv3.common.synchronization [req-ec110ffe-011d-4fa0-a0b0-a099b84ce4d3 req-e7bc3c24-34e0-4546-af36-76e214786ba2 tempest-ServersNegativeTestMultiTenantJSON-1703929549 tempest-ServersNegativeTestMultiTenantJSON-1703929549-project-member] Enqueued Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1195.256499] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGHEST for action security_group_members [ 1195.256904] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.257445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.257445] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.257813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.258010] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.258409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.258409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.258518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.258518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.258854] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.760935] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.761209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.761209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.761362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.761461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.761673] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.761765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.761825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.761982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.762073] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.762159] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa is going to be updated. [ 1195.790705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.790872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.790913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.791257] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.791424] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.801889] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: IN_PROGRESS for 2s [ 1196.026181] env[65353]: INFO networking_nsxv3.common.synchronization [req-2af8b19c-b594-426e-a3fa-91cd204e6b60 req-6cae5125-9189-4bce-935a-36caaab697ce tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1196.026181] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1196.026275] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.026364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.026426] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.026620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.026791] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.026889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.026947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.027276] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.027353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.027443] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.323554] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.323909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.323909] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.324142] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.324391] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.324545] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.324661] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.324902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.325062] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.325272] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.325384] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.325490] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.325596] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.325702] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.325807] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.325937] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.345708] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.345708] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1196.345708] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.345708] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.346036] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-e6ef6c12-8939-405d-9b98-dabb87e55610 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.346156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.346211] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.346495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.346634] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6ef6c12-8939-405d-9b98-dabb87e55610',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.529992] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.849617] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.849839] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.849942] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.850270] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.850426] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.850578] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port e6ef6c12-8939-405d-9b98-dabb87e55610 not found, creating... [ 1196.850884] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.851061] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.851181] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.851333] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.851465] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.851740] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.851898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.852047] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.852260] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.852392] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.852526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: e6ef6c12-8939-405d-9b98-dabb87e55610 is going to be created. [ 1196.873079] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.873298] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.873447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.873654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.873878] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.874111] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.032052] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.534357] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.534922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.534922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.534922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.535254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.535254] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1197.572641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.572888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.572888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.573189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.573382] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.584417] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1197.606439] env[65353]: INFO networking_nsxv3.common.synchronization [req-2af8b19c-b594-426e-a3fa-91cd204e6b60 req-cdc218de-419b-45b1-8dca-e71974bb91cb service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1197.606919] env[65353]: INFO networking_nsxv3.common.synchronization [req-2af8b19c-b594-426e-a3fa-91cd204e6b60 req-cdc218de-419b-45b1-8dca-e71974bb91cb service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1197.606919] env[65353]: INFO networking_nsxv3.common.synchronization [req-2af8b19c-b594-426e-a3fa-91cd204e6b60 req-cdc218de-419b-45b1-8dca-e71974bb91cb service nova] Enqueued Resource ID: e6ef6c12-8939-405d-9b98-dabb87e55610 with Priority: HIGHEST for action port [ 1197.607387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1197.607557] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1197.607667] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ef6c12-8939-405d-9b98-dabb87e55610 with Priority: HIGHEST for action port [ 1197.608014] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.608134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.608199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.608481] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.608565] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.609540] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.609632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.609873] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6ef6c12-8939-405d-9b98-dabb87e55610 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.609969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.610094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.610275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.610346] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6ef6c12-8939-405d-9b98-dabb87e55610',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.810890] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa in Status: SUCCESS [ 1197.811094] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa deletion is rescheduled due to dependency. [ 1197.811218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.112573] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.112730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.112934] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6ef6c12-8939-405d-9b98-dabb87e55610 with status ACTIVE [ 1198.113158] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.113237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.113331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.113557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.113789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.113945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.114054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.114144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.114299] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.114392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.114595] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.114731] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.114789] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.114910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.114996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.115115] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6ef6c12-8939-405d-9b98-dabb87e55610 is going to be updated. [ 1198.138361] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.138361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.138361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.138361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.138361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.138361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6ef6c12-8939-405d-9b98-dabb87e55610" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.594859] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1199.595392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.595392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.595472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.595647] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.595763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.595815] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.595998] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.596103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.596200] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.098414] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.600556] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.103581] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.103782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.103829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.104070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.104166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.104272] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1201.137332] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.137476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.137476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.137687] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.137849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.146984] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1202.609127] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.609410] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1203.158062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1203.158631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.158631] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.158709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.158915] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.159100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.159185] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.159338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.159433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.159558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.159608] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.661582] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.661982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.661982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.662074] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.662740] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.662740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.662929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.663144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.663264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.663431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.663767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.663922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.664049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.664305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.664539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.664692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.664790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.665044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.665198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.665346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.665491] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.168592] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1204.186801] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.187083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.187083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.187326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.187428] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.187690] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.187795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.187860] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.188028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.188107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.188299] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.188392] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.188453] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.188592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.188666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.188842] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.188936] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.188996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.189150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.189223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.189306] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1204.252539] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.252797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.252797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.252916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.253021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.270286] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1206.288142] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1206.288463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.500436] env[65353]: INFO networking_nsxv3.common.synchronization [req-ab077e75-e5e4-4cda-9701-bc800e2f7ed7 req-566daf9f-47cf-4ec8-859f-c26d83621753 tempest-AttachVolumeShelveTestJSON-1761544375 tempest-AttachVolumeShelveTestJSON-1761544375-project-member] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1206.503848] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGHEST for action security_group_members [ 1206.504954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.504954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.504954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.504954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.504954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.504954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.504954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.505349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.505349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.505349] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.007418] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.007611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.007674] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.007898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.008019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.008276] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.008429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.008497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.008672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.008740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.008832] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be updated. [ 1207.040634] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.040897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.040897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.041046] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.041256] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.053873] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: IN_PROGRESS for 2s [ 1207.675634] env[65353]: INFO networking_nsxv3.common.synchronization [req-30a7d164-01cf-4b32-9cd1-c1c33e7af717 req-b0d62f4c-379e-43fd-96e2-60c90ea08f73 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1207.677680] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1207.678024] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.678172] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.678351] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.678473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.678664] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.678817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.678863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.679011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.679355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.679355] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.181739] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.683779] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.068793] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38562f5-e69e-466a-80a0-67c20329559a in Status: SUCCESS [ 1209.068981] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38562f5-e69e-466a-80a0-67c20329559a deletion is rescheduled due to dependency. [ 1209.069118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.188021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.188286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.188387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.188638] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.188782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.188873] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1209.219710] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.219943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.219993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.220224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.220381] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.230796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1211.242701] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1211.243083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.678860] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.679253] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1217.680299] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.680511] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1218.509295] env[65353]: INFO networking_nsxv3.common.synchronization [req-65f5e5a3-9d42-4fb1-9a25-e77df2994b70 req-ba4770c2-1365-42b2-a752-bd3c4680ef13 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1218.510015] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1218.510388] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.510527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.510593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.510886] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.510952] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.511151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.511151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.511305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.511349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.511443] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.803040] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.803373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.803373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.803622] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.803998] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.804115] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.804158] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.804369] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.804563] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.804871] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.804987] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.805173] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.805283] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.805394] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.805496] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.805620] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.829044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.829226] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1218.829361] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.829534] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-833" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.829840] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-d7602f11-87c2-4415-ba36-346a27753d80 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.830015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.830143] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.830675] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.830816] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7602f11-87c2-4415-ba36-346a27753d80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.014413] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.332934] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.333159] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.333159] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.333468] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.333629] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.333786] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port d7602f11-87c2-4415-ba36-346a27753d80 not found, creating... [ 1219.334084] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.334256] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.334374] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.334591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.335022] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.335118] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.335289] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.335405] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.335811] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.335811] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.335895] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: d7602f11-87c2-4415-ba36-346a27753d80 is going to be created. [ 1219.356376] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.356615] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.356715] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.357106] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.357363] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.357595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.387830] env[65353]: INFO networking_nsxv3.common.synchronization [req-cbae3059-a91a-424d-913a-b22bcd22a57e req-d1fb712e-7725-4412-96f2-5cef4f8bb5a6 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1219.388436] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1219.388739] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.388852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.388916] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.389137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.389324] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.389423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.389477] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.389603] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.389682] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.389775] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.517937] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.891659] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.024377] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.024377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.024377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.024377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.024571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.024615] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1220.064028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.064028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.064028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.064364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.064409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.073715] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1220.109296] env[65353]: INFO networking_nsxv3.common.synchronization [req-65f5e5a3-9d42-4fb1-9a25-e77df2994b70 req-852a109b-ca18-4f37-bf9f-0c776a65add7 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1220.109471] env[65353]: INFO networking_nsxv3.common.synchronization [req-65f5e5a3-9d42-4fb1-9a25-e77df2994b70 req-852a109b-ca18-4f37-bf9f-0c776a65add7 service nova] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1220.109604] env[65353]: INFO networking_nsxv3.common.synchronization [req-65f5e5a3-9d42-4fb1-9a25-e77df2994b70 req-852a109b-ca18-4f37-bf9f-0c776a65add7 service nova] Enqueued Resource ID: d7602f11-87c2-4415-ba36-346a27753d80 with Priority: HIGHEST for action port [ 1220.110154] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_rules [ 1220.110291] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1220.110387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7602f11-87c2-4415-ba36-346a27753d80 with Priority: HIGHEST for action port [ 1220.110709] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.110902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.110980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.111836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.111836] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.115417] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.115417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.115417] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7602f11-87c2-4415-ba36-346a27753d80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.115417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.115417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.115417] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.115417] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7602f11-87c2-4415-ba36-346a27753d80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.393847] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.615265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.615494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.615569] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7602f11-87c2-4415-ba36-346a27753d80 with status ACTIVE [ 1220.615792] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.615905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.615975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.616229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.616338] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.616520] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.616615] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.616696] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.616892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.617045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.617249] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.617362] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.617457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.617607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.617704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.617827] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7602f11-87c2-4415-ba36-346a27753d80 is going to be updated. [ 1220.639853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.640091] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.640142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.640350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.640493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.640650] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7602f11-87c2-4415-ba36-346a27753d80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.898443] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.899035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.899035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.899035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.899035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.899242] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1220.932686] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.933238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.933238] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.933364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.933535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.945262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1222.084449] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1222.084764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.084859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.085106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.085245] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.085356] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.085423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.085613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.085645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.085775] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.588575] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.955602] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1222.955806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.093650] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.596023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.596254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.596308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.596541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.596634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.596735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1223.634968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.635226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.635226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.635501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.635655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.645123] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1225.110953] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.111367] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1225.657760] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1225.657943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.658141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.658430] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.658601] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.658730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.658811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.659011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.659107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.659289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.659436] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.161943] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.162291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.162291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.162449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.162612] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.162707] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.162766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.162960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.163068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.163170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.163327] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.163437] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.163509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.163711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.163889] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.164016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.164100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.164307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.164435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.164582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.164732] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.667704] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882b2338-35d8-46b9-8073-3ad5e6845597: rpc.has_security_group_logging(os_id): False [ 1226.687075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.687075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.687075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.687075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.687450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.687450] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.687547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.687547] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.687719] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.687795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.687991] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.688097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.688202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.688364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.688439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.688657] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.688755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.688844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.688993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.689110] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.689202] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1226.757143] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.757360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.757407] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.757608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.757776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.776651] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1228.797506] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1228.797921] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.112524] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.112907] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1232.048148] env[65353]: INFO networking_nsxv3.common.synchronization [req-a4e4ca79-4375-411a-afeb-4c277786a652 req-cd2fe3f8-71c5-4417-9458-76f18fd1b643 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1232.048715] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1232.049976] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.049976] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.049976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.050492] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.552203] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.056570] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.559803] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.560114] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.560242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.560500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.560595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.560704] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1233.589350] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.589590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.589643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.589902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.590107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.599743] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1235.611499] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1235.611841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.280408] env[65353]: INFO networking_nsxv3.common.synchronization [req-59e90793-b5c7-4fa5-9a00-b757bbe4c0e3 req-675e84ff-144f-4d07-83f2-9cf2290b88a6 tempest-ServerActionsTestOtherA-465621883 tempest-ServerActionsTestOtherA-465621883-project-member] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1236.281382] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGHEST for action security_group_members [ 1236.281750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.281858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.281922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.282191] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.282411] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.282565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.282668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.282890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.283014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.283138] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.787235] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.787660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.787660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.787660] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.787791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.787946] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.788056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.788119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.788267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.788344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.788430] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be updated. [ 1236.816894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.817109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.817109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.817377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.817527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.827017] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: IN_PROGRESS for 2s [ 1238.303260] env[65353]: INFO networking_nsxv3.common.synchronization [req-dee41de5-1db9-44ee-8d52-8af3ac50027e req-9602c723-f6d0-4999-a019-051686392eb9 tempest-ServersTestJSON-1587527088 tempest-ServersTestJSON-1587527088-project-member] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1238.303856] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGHEST for action security_group_members [ 1238.304213] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.304367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.304457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.304678] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.305208] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.305208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.305208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.305208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.305432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.305432] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.808034] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.808242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.808292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.809062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.809062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.809062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.809062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.809062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.809318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.809318] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.809318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be updated. [ 1238.840434] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.840633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.840675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.840864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.841014] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.842814] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 in Status: SUCCESS [ 1238.842957] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 deletion is rescheduled due to dependency. [ 1238.843072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.849833] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: IN_PROGRESS for 2s [ 1240.862384] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882b2338-35d8-46b9-8073-3ad5e6845597 in Status: SUCCESS [ 1240.862726] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 deletion is rescheduled due to dependency. [ 1240.862726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.304832] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.305239] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.870199] env[65353]: INFO networking_nsxv3.common.synchronization [None req-0e095ae5-8355-4692-ab1f-de1e9b40f70c None None] Enqueued Resource ID: 5a838f19-77a1-4216-9f42-1eebfcbf744b with Priority: HIGHEST for action port [ 1246.871471] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a838f19-77a1-4216-9f42-1eebfcbf744b with Priority: HIGHEST for action port [ 1246.871471] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a838f19-77a1-4216-9f42-1eebfcbf744b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.871573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a838f19-77a1-4216-9f42-1eebfcbf744b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.871573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a838f19-77a1-4216-9f42-1eebfcbf744b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.871970] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a838f19-77a1-4216-9f42-1eebfcbf744b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.872067] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a838f19-77a1-4216-9f42-1eebfcbf744b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.245043] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.245043] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.245043] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.245272] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.245541] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.245697] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.245810] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.246091] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.246274] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.246508] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.246650] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.246779] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.246907] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.247047] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.247193] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.247685] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.268930] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.269113] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1247.269255] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.269428] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-873" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.269743] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-aee310ba-91ab-43b9-9656-f6b6a4ac126e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.269906] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.270036] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.270309] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.270465] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee310ba-91ab-43b9-9656-f6b6a4ac126e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.374631] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a838f19-77a1-4216-9f42-1eebfcbf744b [ 1247.374890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.375126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.375213] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.375443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.375532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.375627] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a838f19-77a1-4216-9f42-1eebfcbf744b already deleted. [ 1247.375709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a838f19-77a1-4216-9f42-1eebfcbf744b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.491783] env[65353]: INFO networking_nsxv3.common.synchronization [None req-eb8a5cc8-6005-4ebc-95af-542eac7ed91f tempest-ServerActionsV293TestJSON-615913204 tempest-ServerActionsV293TestJSON-615913204-project-member] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1247.492438] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1247.492636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.492757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.492856] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.493268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.493464] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.566662] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3acaa2e5-1767-4a32-a16d-19d171fc8928 tempest-ServerActionsV293TestJSON-615913204 tempest-ServerActionsV293TestJSON-615913204-project-member] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1247.567242] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1247.567588] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.567684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.772733] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.772952] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.773261] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.773373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.773518] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.773798] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.774112] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.774112] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.774283] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.774542] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.774836] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.774986] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.775108] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.775349] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.775491] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.775664] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e is going to be updated. [ 1247.797819] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.798205] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.798205] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.798517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.798716] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.799060] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.016674] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.017028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.017028] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.017122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.017327] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.017327] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e already deleted. [ 1248.017449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.017562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.017697] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.017779] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.534476] env[65353]: INFO networking_nsxv3.common.synchronization [req-23200ecd-795d-460b-8dd6-0569fb6146f8 req-dd2127fa-036c-468d-9835-7dc9d0729ef3 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1248.534660] env[65353]: INFO networking_nsxv3.common.synchronization [req-23200ecd-795d-460b-8dd6-0569fb6146f8 req-dd2127fa-036c-468d-9835-7dc9d0729ef3 service nova] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1248.534797] env[65353]: INFO networking_nsxv3.common.synchronization [req-23200ecd-795d-460b-8dd6-0569fb6146f8 req-dd2127fa-036c-468d-9835-7dc9d0729ef3 service nova] Enqueued Resource ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e with Priority: HIGHEST for action port [ 1248.535325] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_rules [ 1248.535462] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1248.535555] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e with Priority: HIGHEST for action port [ 1248.535825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.535971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.536013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.536459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.536538] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.538250] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.538448] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.538507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.538689] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.538836] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.538932] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.538992] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.539145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.539261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.539306] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.540184] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee310ba-91ab-43b9-9656-f6b6a4ac126e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.540253] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.540321] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.541306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.541306] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee310ba-91ab-43b9-9656-f6b6a4ac126e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.543556] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.543671] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.543737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.543903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.543989] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.544092] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e already deleted. [ 1248.544174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.042980] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.042980] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.042980] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.045838] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aee310ba-91ab-43b9-9656-f6b6a4ac126e with status ACTIVE [ 1249.046063] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.046248] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.046322] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.046537] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.046630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.046807] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.046939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.047067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.047337] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.047438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.047676] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.047756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.047849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.047954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.048133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.048418] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aee310ba-91ab-43b9-9656-f6b6a4ac126e is going to be updated. [ 1249.072123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.072325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.072325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.072844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.072844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.072844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee310ba-91ab-43b9-9656-f6b6a4ac126e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.283658] env[65353]: INFO networking_nsxv3.common.synchronization [None req-ecddc06d-b00b-4048-ab71-a69c50c55a3b None None] Enqueued Resource ID: 41fbe9e2-c488-4178-92e9-71d88b767c76 with Priority: HIGHEST for action port [ 1249.284232] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fbe9e2-c488-4178-92e9-71d88b767c76 with Priority: HIGHEST for action port [ 1249.284548] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fbe9e2-c488-4178-92e9-71d88b767c76 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.284668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fbe9e2-c488-4178-92e9-71d88b767c76" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.284734] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fbe9e2-c488-4178-92e9-71d88b767c76" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.284987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fbe9e2-c488-4178-92e9-71d88b767c76" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.285086] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fbe9e2-c488-4178-92e9-71d88b767c76',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.545226] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.787707] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41fbe9e2-c488-4178-92e9-71d88b767c76 [ 1249.787925] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.788096] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.788197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.788450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.788552] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.788618] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41fbe9e2-c488-4178-92e9-71d88b767c76 already deleted. [ 1249.788711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fbe9e2-c488-4178-92e9-71d88b767c76" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.047348] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.047747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.047747] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.047830] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.047871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.047974] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1250.080750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.080979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.080979] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.081204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.081357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.090344] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1252.103796] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1252.104182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.104182] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.104395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.104680] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.104841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.104924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.105156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.105335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.105484] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.105626] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.610244] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.114521] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff: rpc.has_security_group_logging(os_id): False [ 1253.133895] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.134161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.134161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.134349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.134457] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.134706] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.134804] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.134865] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.135035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.135134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.135282] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1253.200197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.200429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.200429] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.200681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.200869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.217732] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1254.285799] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.286217] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1255.235127] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1255.235365] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.146575] env[65353]: INFO networking_nsxv3.common.synchronization [req-ee9d4411-f17a-4df0-a88d-c2092c01f751 req-3293f695-d7e3-45dd-9878-c2726876b428 tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1258.147560] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGHEST for action security_group_members [ 1258.148583] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.148583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.148583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.148583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.148823] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.148944] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.149108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.149561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.149561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.149561] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.652554] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.652796] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.652850] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.653121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.653214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.653424] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.653542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.653606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.653943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.654086] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.654193] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce is going to be updated. [ 1258.686328] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.686628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.686628] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.686774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.686826] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.696526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: IN_PROGRESS for 2s [ 1260.129677] env[65353]: INFO networking_nsxv3.common.synchronization [req-863290b5-d750-416b-93c9-68a26e56d0ea req-088954f3-b5a8-4221-adea-0fd32ddcc29c tempest-AttachVolumeTestJSON-86356480 tempest-AttachVolumeTestJSON-86356480-project-member] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1260.130914] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGHEST for action security_group_members [ 1260.131404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.131404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.131404] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.131632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.131745] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.131839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.131903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.132067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.132150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.132245] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.634659] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.634819] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.634890] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.635147] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.635244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.635446] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.635544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.635641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.635763] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.635906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.636015] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 is going to be updated. [ 1260.662316] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.662569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.662690] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.662873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.663016] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.672357] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: IN_PROGRESS for 2s [ 1260.706087] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2996eed-d1f2-4333-a319-97d66b50fdce in Status: SUCCESS [ 1260.706281] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce deletion is rescheduled due to dependency. [ 1260.706396] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.682577] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 in Status: SUCCESS [ 1262.682913] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 deletion is rescheduled due to dependency. [ 1262.682913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.492696] env[65353]: INFO networking_nsxv3.common.synchronization [req-f7e663cd-884b-48f4-9a83-8930c99591a1 req-5003886f-21a0-474f-ba80-ba76e98a6696 tempest-ServerActionsTestOtherB-83309006 tempest-ServerActionsTestOtherB-83309006-project-member] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1264.493479] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGHEST for action security_group_members [ 1264.493816] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.493939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.494017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.494245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.494477] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.494593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.494655] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.494807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.494903] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.494993] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.999215] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.999441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.999441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.999652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.999745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.999951] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.000063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.000118] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.000261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.000331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.000415] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be updated. [ 1265.053846] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.054102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.054102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.054296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.054442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.070460] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: IN_PROGRESS for 2s [ 1267.081753] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff in Status: SUCCESS [ 1267.082180] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff deletion is rescheduled due to dependency. [ 1267.082180] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.494964] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.495219] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.200366] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1270.200549] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1274.438112] env[65353]: INFO networking_nsxv3.common.synchronization [req-caf4d996-7be0-4d86-88ea-c5922d8633fe req-1dfe8da5-d31c-4ae3-af10-5739109122a5 tempest-ServerActionsV293TestJSON-615913204 tempest-ServerActionsV293TestJSON-615913204-project-member] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1274.438645] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1274.438979] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.439104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.439178] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.439458] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.439647] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.439745] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.439806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.440119] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.440254] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.440299] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.869895] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.870108] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-393" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.870233] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-393" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.870560] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-393" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.870815] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.871121] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.872021] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.872319] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.872495] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.872727] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.872852] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.872958] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.873078] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.873191] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.873316] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.873523] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.898075] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.898284] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.898584] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.898659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-393" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.898959] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-f64d0480-4098-443c-964d-047eb553d1b7 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.899146] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.899267] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.899586] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.899725] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64d0480-4098-443c-964d-047eb553d1b7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.942761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.942960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.942960] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.943108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.943200] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.943397] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.943500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.943893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.943893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.943893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.943893] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e already deleted. [ 1274.944045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.119879] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.120040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.120163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.120319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.121228] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.402291] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.402513] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.402641] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.402926] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.403088] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.403240] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port f64d0480-4098-443c-964d-047eb553d1b7 not found, creating... [ 1275.403496] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.403651] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.403766] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.403979] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.404129] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.404412] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.404582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.404674] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.404876] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.405013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.405153] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: f64d0480-4098-443c-964d-047eb553d1b7 is going to be created. [ 1275.425008] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.425241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.425367] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.425640] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.425871] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.426144] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.622230] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.125036] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.155638] env[65353]: INFO networking_nsxv3.common.synchronization [req-caf4d996-7be0-4d86-88ea-c5922d8633fe req-8b0675f2-1cc7-41a7-be3c-7d5769f8724a service nova] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1276.155638] env[65353]: INFO networking_nsxv3.common.synchronization [req-caf4d996-7be0-4d86-88ea-c5922d8633fe req-8b0675f2-1cc7-41a7-be3c-7d5769f8724a service nova] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1276.155844] env[65353]: INFO networking_nsxv3.common.synchronization [req-caf4d996-7be0-4d86-88ea-c5922d8633fe req-8b0675f2-1cc7-41a7-be3c-7d5769f8724a service nova] Enqueued Resource ID: f64d0480-4098-443c-964d-047eb553d1b7 with Priority: HIGHEST for action port [ 1276.156300] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_rules [ 1276.156300] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1276.156300] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64d0480-4098-443c-964d-047eb553d1b7 with Priority: HIGHEST for action port [ 1276.156743] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.156858] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.156926] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.157227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.157321] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.158223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.158624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.158624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.158624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.158786] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.158882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.158882] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.159053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.159141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.159229] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.160207] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-f64d0480-4098-443c-964d-047eb553d1b7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.160326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.160375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.161634] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.161634] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64d0480-4098-443c-964d-047eb553d1b7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.629417] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1276.629712] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1276.662670] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.662670] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.662882] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.663655] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f64d0480-4098-443c-964d-047eb553d1b7 with status ACTIVE [ 1276.663834] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.663943] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.664015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.664223] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.664313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.664477] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.664611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.664654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.664777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.664927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.665028] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.665121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.665170] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.665774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.665774] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.665774] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f64d0480-4098-443c-964d-047eb553d1b7 is going to be updated. [ 1276.686361] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.686572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.686572] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.686770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.686912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.687085] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f64d0480-4098-443c-964d-047eb553d1b7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.167420] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.470668] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.470668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.470668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.470668] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.481865] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1277.482983] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.484296] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1277.522139] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.522290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.522369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.522571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.535510] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.536290] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1277.536373] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.536501] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1277.578712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.578894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.578933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.579164] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.580442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.580677] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1277.654325] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.654728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.654728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.654728] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.654953] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.655235] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1277.669888] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.670247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.670247] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.670469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.670469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.670469] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e is going to be created. [ 1277.691993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.692270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.692270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.692558] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.692611] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.701975] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: UNINITIALIZED for 2s [ 1277.760290] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.760533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.760533] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.760742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.760987] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.761293] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1277.761387] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ee283bce-4b1f-47a4-b9bc-1f0367034344', '882b2338-35d8-46b9-8073-3ad5e6845597', 'a9e4cc2e-7db9-4ecb-adb0-1ff58af51797', 'a28dd6d0-e311-4f5d-a6ed-59453af2dcc0', 'a2996eed-d1f2-4333-a319-97d66b50fdce', '6201df91-3340-45fd-8fb5-eb672e417941', '9a15abaf-4694-449c-9040-c4b1acb179c0', 'f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa', '0b59c8a2-e271-42d7-9144-e62c90117e8b', '5b9cd2d9-7e06-497a-a422-6b045be4a832', 'f9614eb5-4fb3-4d03-8d1c-b9427ffd4934', 'a38562f5-e69e-466a-80a0-67c20329559a', '56622075-2f39-4c3e-86af-b1c6fc510beb', 'da59ee93-ae54-4a16-87c6-1b9e93ee605e', '5171ec2a-8acc-4736-a34b-cf763dc5c9f7', 'c2f635c3-4601-4155-b8e5-e2dab677e518', '1e718fc6-a572-4276-83ab-0e7e530140d0', '66ea3edd-9280-4ba2-b412-ca1c1ac57a2a', 'fcebdf84-f874-4db4-b283-bda9c57166cf', '400ed73f-78cb-4aac-8a3b-e0415f1fbf19', 'b9972817-ff77-432f-a5cd-8388f88bd29a', '357b71ae-4236-49a4-9cb3-5cec4c42e443', 'e8cbd2fb-a386-46ba-9054-c04ccc0a46d9', 'fc6d712f-e111-4ee3-8ed1-729c0a27074b', '3469e958-4a31-4f2a-987e-042bbed3a4ae', '2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff', '4fb5d077-5aae-475f-9ce6-a007397ccf52', 'ff847f4a-e188-46a1-bbea-b7ce5960a51a', 'f70850f2-6628-4be4-939e-95e5fadec74b', '45e4fdd1-656b-4cc6-ba66-7fc4257c0446', '4ef686cd-78eb-46c8-a0b8-b56b7873d69d', 'e5fbec70-0464-48ee-8744-b368faac3797', 'dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad', '1a2987c0-489b-45df-9694-cf09b0682b7c', 'eef90e1f-f512-4c74-82f2-c918b64f5aee', 'cadcc6df-baac-43fd-bf48-5485c0b69d95', '101d7123-33df-4206-98ea-c31321fdee80', 'e0209ced-141c-4ff9-b95c-1f2fc770b1f0', '0bceb08f-d9a1-4677-8b2e-0aeacfbbb531', '187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5', 'e9cb80b2-00dd-48f3-aba0-08eecbed0594'} {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.761521] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1277.783040] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.783410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.783410] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.783574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.783574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.783706] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1277.783706] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.783771] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1277.895780] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.896100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.896100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.896271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.897444] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.897752] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1277.897864] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.897912] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1277.897963] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1277.898046] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1277.898122] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGH for action security_group_rules [ 1277.898209] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGH for action security_group_rules [ 1277.898272] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 1277.898336] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGH for action security_group_rules [ 1277.898398] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGH for action security_group_rules [ 1277.898459] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGH for action security_group_rules [ 1277.898521] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGH for action security_group_rules [ 1277.898579] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGH for action security_group_rules [ 1277.898639] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 1277.898721] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGH for action security_group_rules [ 1277.898823] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGH for action security_group_rules [ 1277.898823] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGH for action security_group_rules [ 1277.898918] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGH for action security_group_rules [ 1277.898988] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGH for action security_group_rules [ 1277.899064] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGH for action security_group_rules [ 1277.899128] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGH for action security_group_rules [ 1277.899190] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGH for action security_group_rules [ 1277.899246] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGH for action security_group_rules [ 1277.899308] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGH for action security_group_rules [ 1277.899369] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGH for action security_group_rules [ 1277.899469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.358418] env[65353]: INFO networking_nsxv3.common.synchronization [None req-8c57af97-e00d-4462-bc0a-14aad68a36de None None] Enqueued Resource ID: 40b929fe-1c8c-4d08-958f-ca53cddd9794 with Priority: HIGHEST for action port [ 1278.358967] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b929fe-1c8c-4d08-958f-ca53cddd9794 with Priority: HIGHEST for action port [ 1278.359096] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 with Priority: HIGH for action security_group_rules [ 1278.359388] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 with Priority: HIGH for action security_group_rules [ 1278.359388] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 with Priority: HIGH for action security_group_rules [ 1278.359388] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 with Priority: HIGH for action security_group_rules [ 1278.359510] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 with Priority: HIGH for action security_group_rules [ 1278.359548] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcebdf84-f874-4db4-b283-bda9c57166cf with Priority: HIGH for action security_group_rules [ 1278.359620] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGH for action security_group_rules [ 1278.359805] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 with Priority: HIGH for action security_group_rules [ 1278.359805] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e with Priority: HIGH for action security_group_rules [ 1278.359872] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f635c3-4601-4155-b8e5-e2dab677e518 with Priority: HIGH for action security_group_rules [ 1278.359949] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56622075-2f39-4c3e-86af-b1c6fc510beb with Priority: HIGH for action security_group_rules [ 1278.360214] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38562f5-e69e-466a-80a0-67c20329559a with Priority: HIGH for action security_group_rules [ 1278.360214] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 with Priority: HIGH for action security_group_rules [ 1278.360214] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 with Priority: HIGH for action security_group_rules [ 1278.360352] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b with Priority: HIGH for action security_group_rules [ 1278.360387] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6201df91-3340-45fd-8fb5-eb672e417941 with Priority: HIGH for action security_group_rules [ 1278.360447] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa with Priority: HIGH for action security_group_rules [ 1278.360552] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2996eed-d1f2-4333-a319-97d66b50fdce with Priority: HIGH for action security_group_rules [ 1278.360688] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882b2338-35d8-46b9-8073-3ad5e6845597 with Priority: HIGH for action security_group_rules [ 1278.360745] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 with Priority: HIGH for action security_group_rules [ 1278.361023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-40b929fe-1c8c-4d08-958f-ca53cddd9794 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.361146] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40b929fe-1c8c-4d08-958f-ca53cddd9794" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.361227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40b929fe-1c8c-4d08-958f-ca53cddd9794" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.361644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40b929fe-1c8c-4d08-958f-ca53cddd9794" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.361644] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b929fe-1c8c-4d08-958f-ca53cddd9794',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.362392] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee283bce-4b1f-47a4-b9bc-1f0367034344 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.362497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.362561] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.362729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.362804] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee283bce-4b1f-47a4-b9bc-1f0367034344',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.364692] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.364692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.364692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.364692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.364692] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e4cc2e-7db9-4ecb-adb0-1ff58af51797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.365930] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a15abaf-4694-449c-9040-c4b1acb179c0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.365930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.366072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.366124] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.366276] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a15abaf-4694-449c-9040-c4b1acb179c0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.366882] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.366991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.370370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5171ec2a-8acc-4736-a34b-cf763dc5c9f7',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.370370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.370370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400ed73f-78cb-4aac-8a3b-e0415f1fbf19',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.370370] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcebdf84-f874-4db4-b283-bda9c57166cf taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.370370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.370370] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcebdf84-f874-4db4-b283-bda9c57166cf',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.370842] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.371041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.371041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.371347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.371347] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.371890] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e718fc6-a572-4276-83ab-0e7e530140d0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.371991] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.372058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.372214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.372312] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e718fc6-a572-4276-83ab-0e7e530140d0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.373280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.373388] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.373454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.374613] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.374613] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da59ee93-ae54-4a16-87c6-1b9e93ee605e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.375019] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2f635c3-4601-4155-b8e5-e2dab677e518 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.375130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.375196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.375368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.375793] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2f635c3-4601-4155-b8e5-e2dab677e518',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.376580] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56622075-2f39-4c3e-86af-b1c6fc510beb taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.376739] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.376839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.376995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.377080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56622075-2f39-4c3e-86af-b1c6fc510beb',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.377825] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38562f5-e69e-466a-80a0-67c20329559a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.378094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.378142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.378335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.378419] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38562f5-e69e-466a-80a0-67c20329559a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.379359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.379441] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.379503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.380158] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.380240] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9614eb5-4fb3-4d03-8d1c-b9427ffd4934',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.380897] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9cd2d9-7e06-497a-a422-6b045be4a832 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.381135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.381135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.381226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.381296] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9cd2d9-7e06-497a-a422-6b045be4a832',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.382364] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b59c8a2-e271-42d7-9144-e62c90117e8b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.382471] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.382534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.382686] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.382760] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b59c8a2-e271-42d7-9144-e62c90117e8b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.383590] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6201df91-3340-45fd-8fb5-eb672e417941 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.383925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.383925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.383925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.383925] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6201df91-3340-45fd-8fb5-eb672e417941',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.384639] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.384751] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.384817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.384966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.385049] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.385973] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2996eed-d1f2-4333-a319-97d66b50fdce taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.385973] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.386108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.386226] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.386797] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2996eed-d1f2-4333-a319-97d66b50fdce',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.387238] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882b2338-35d8-46b9-8073-3ad5e6845597 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.387372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.387438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.387586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.387687] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882b2338-35d8-46b9-8073-3ad5e6845597',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.388422] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.388521] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.388633] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.389237] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.389237] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28dd6d0-e311-4f5d-a6ed-59453af2dcc0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.389376] env[65353]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1278.899788] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40b929fe-1c8c-4d08-958f-ca53cddd9794 [ 1278.899788] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.899788] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40b929fe-1c8c-4d08-958f-ca53cddd9794 already deleted. [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40b929fe-1c8c-4d08-958f-ca53cddd9794" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.899788] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.899788] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.899788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.901177] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.003598] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.004281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.004281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.004281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.007978] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.008145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.008995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.009111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.009945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.010062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.011023] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.011023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.011531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.011649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.012404] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.012496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.013076] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.013225] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.013833] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.013920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.014660] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.014768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.015575] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.015575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.016156] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.016569] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.016759] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.017250] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.017601] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.017705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.018641] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.019020] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.019112] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.020579] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.020882] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.020982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.021627] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.022062] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.022134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.022700] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.023083] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.023194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.023746] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.024251] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.024251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.024923] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.025161] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.025268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.026255] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b0ab494c-1128-46c7-9221-0e13583ebcf0 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1279.026974] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1279.027266] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.027375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.027440] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.027705] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.027798] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.038073] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.039522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.039522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcebdf84-f874-4db4-b283-bda9c57166cf is going to be deleted. [ 1279.040402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.040402] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.064965] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.065111] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e718fc6-a572-4276-83ab-0e7e530140d0 is going to be deleted. [ 1279.065988] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.066208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.086015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.086151] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2996eed-d1f2-4333-a319-97d66b50fdce is going to be deleted. [ 1279.087055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.087262] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.098112] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.098269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.109205] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c081be8d-2917-437d-ab2e-3cb487c4b9a3 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1279.109921] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1279.110420] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.110420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.114034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.114034] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5171ec2a-8acc-4736-a34b-cf763dc5c9f7 is going to be deleted. [ 1279.114652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.114950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.118912] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.119049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.151573] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.151719] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882b2338-35d8-46b9-8073-3ad5e6845597 is going to be deleted. [ 1279.152654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.153475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.155824] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.155958] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.231165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.231355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.236891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.236891] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee283bce-4b1f-47a4-b9bc-1f0367034344 is going to be deleted. [ 1279.236891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.236891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.295693] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.295924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.297045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.297204] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b59c8a2-e271-42d7-9144-e62c90117e8b is going to be deleted. [ 1279.298454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.298812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.376927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.377554] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6201df91-3340-45fd-8fb5-eb672e417941 is going to be deleted. [ 1279.378648] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.378884] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.422080] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.468565] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.468773] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38562f5-e69e-466a-80a0-67c20329559a is going to be deleted. [ 1279.469840] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.470379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.508479] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.508606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.518197] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.518726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.536021] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.536021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da59ee93-ae54-4a16-87c6-1b9e93ee605e is going to be deleted. [ 1279.536188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.536303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.648586] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.648586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.654271] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.654271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.654816] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.654932] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9cd2d9-7e06-497a-a422-6b045be4a832 is going to be deleted. [ 1279.656058] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.656280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.670137] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.670290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.717836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.717836] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa is going to be deleted. [ 1279.717836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.717836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.763365] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: SUCCESS [ 1279.763564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.763752] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.763972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.764185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.764306] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.764372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.764519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.764598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.764685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.764776] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.774436] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.774585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.777794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.777920] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9614eb5-4fb3-4d03-8d1c-b9427ffd4934 is going to be deleted. [ 1279.778955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.779189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.830381] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.830570] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.854657] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.854896] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a15abaf-4694-449c-9040-c4b1acb179c0 is going to be deleted. [ 1279.855905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.856137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.884015] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.884015] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56622075-2f39-4c3e-86af-b1c6fc510beb is going to be deleted. [ 1279.884710] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.884905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.888954] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.888954] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.920971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.921329] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400ed73f-78cb-4aac-8a3b-e0415f1fbf19 is going to be deleted. [ 1279.922272] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.922522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.925297] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a: rpc.has_security_group_logging(os_id): False [ 1279.953088] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.953286] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.968947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.969136] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2f635c3-4601-4155-b8e5-e2dab677e518 is going to be deleted. [ 1279.970136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.970385] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.971816] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.971913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.003382] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.003597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.017089] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.017318] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e4cc2e-7db9-4ecb-adb0-1ff58af51797 is going to be deleted. [ 1280.018309] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.018665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.019906] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.020084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.077447] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.077447] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28dd6d0-e311-4f5d-a6ed-59453af2dcc0 is going to be deleted. [ 1280.078168] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcebdf84-f874-4db4-b283-bda9c57166cf" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.079277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e718fc6-a572-4276-83ab-0e7e530140d0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.080038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.080038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.080038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.080038] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2996eed-d1f2-4333-a319-97d66b50fdce" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.080312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.080312] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.080367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.080476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5171ec2a-8acc-4736-a34b-cf763dc5c9f7" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882b2338-35d8-46b9-8073-3ad5e6845597" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.081132] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.081450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee283bce-4b1f-47a4-b9bc-1f0367034344" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081450] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.081559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.081640] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b59c8a2-e271-42d7-9144-e62c90117e8b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.082115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.082115] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.082236] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 already deleted. [ 1280.082290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.082389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.082606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.082700] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.082797] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6201df91-3340-45fd-8fb5-eb672e417941" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.082875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.083030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.083114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.084607] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.084757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.084757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.084897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.084975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.085167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2f635c3-4601-4155-b8e5-e2dab677e518" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.085827] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.085923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.086079] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.086331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.086331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.086331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400ed73f-78cb-4aac-8a3b-e0415f1fbf19" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.086497] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.086969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.086969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.086969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38562f5-e69e-466a-80a0-67c20329559a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.086969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.086969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.087252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.087252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da59ee93-ae54-4a16-87c6-1b9e93ee605e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.087308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.087393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.087905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.087905] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9cd2d9-7e06-497a-a422-6b045be4a832" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.088192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.088243] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088369] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ad2d8b-ba8e-4f42-a60e-a38d1d1fc2fa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088460] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.088649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.088649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9614eb5-4fb3-4d03-8d1c-b9427ffd4934" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.088931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.089030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.089163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.089227] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a15abaf-4694-449c-9040-c4b1acb179c0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.089375] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.089500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.150933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.151359] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.151476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.151593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.151802] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.151900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.151989] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1280.153198] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.153384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.153498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.153625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56622075-2f39-4c3e-86af-b1c6fc510beb" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.154418] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.154541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.154596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.154757] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.154839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.154951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e4cc2e-7db9-4ecb-adb0-1ff58af51797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.191375] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.191596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.191636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.191833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.191929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.192072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28dd6d0-e311-4f5d-a6ed-59453af2dcc0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.240360] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.240590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.240590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.240811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.241044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.255887] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1280.267580] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.609641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.609817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.609930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.610199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.610296] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.610395] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 already deleted. [ 1280.610475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.665614] env[65353]: INFO networking_nsxv3.common.synchronization [None req-f06229da-fecb-482c-a827-c001b4ef65dc None None] Enqueued Resource ID: d2f1df4b-066c-4138-a96f-79df5142449b with Priority: HIGHEST for action port [ 1280.666555] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2f1df4b-066c-4138-a96f-79df5142449b with Priority: HIGHEST for action port [ 1280.666555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2f1df4b-066c-4138-a96f-79df5142449b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.666555] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2f1df4b-066c-4138-a96f-79df5142449b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.666822] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2f1df4b-066c-4138-a96f-79df5142449b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.667121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2f1df4b-066c-4138-a96f-79df5142449b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.667246] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f1df4b-066c-4138-a96f-79df5142449b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.770044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f60678f1-eecc-4faf-ba97-7a783a30409e: rpc.has_security_group_logging(os_id): False [ 1280.788641] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.788893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.788893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.789207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.789207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.789632] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.789632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.789632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.789772] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.790134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.790134] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e is going to be created. [ 1280.886512] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.886810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.886810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.886941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.887138] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.901845] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: IN_PROGRESS for 2s [ 1281.169404] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2f1df4b-066c-4138-a96f-79df5142449b [ 1281.169721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.169805] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.169847] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.170099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.170197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.170297] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2f1df4b-066c-4138-a96f-79df5142449b already deleted. [ 1281.170376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2f1df4b-066c-4138-a96f-79df5142449b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.269821] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1282.270267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.939850] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: SUCCESS [ 1282.940196] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.654378] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7607b39-4dcf-45d6-aa15-3ca3bfb059c2 req-cf2d8cd9-c94e-4152-b94c-20ea5d57c7c1 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1284.654897] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1284.655216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.655335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.655400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.655680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.655853] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.655952] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.656023] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.656189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.656269] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.656369] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.909913] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.909913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.909913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.909913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.909913] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.909913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.909913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.910327] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.910364] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.910577] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.910694] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.910801] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.910912] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.911079] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.911211] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.911349] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.932231] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.932412] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1284.932528] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.932700] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.933609] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-cd99fc87-404b-4af2-8f83-fd0b967442ca taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.933609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.933609] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.933948] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.933948] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd99fc87-404b-4af2-8f83-fd0b967442ca',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.158545] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.158790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.158912] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.159064] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.159159] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.159366] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.159464] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.159526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.159711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.159818] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.159913] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 already deleted. [ 1285.159997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.436318] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.436498] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.436543] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.436841] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.436994] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.437171] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port cd99fc87-404b-4af2-8f83-fd0b967442ca not found, creating... [ 1285.437429] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.437703] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.437777] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.437966] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.438121] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.438398] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.438548] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.438692] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.438891] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.439193] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.439336] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: cd99fc87-404b-4af2-8f83-fd0b967442ca is going to be created. [ 1285.460566] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.460769] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.460889] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.461188] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.461496] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.461794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.133787] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7607b39-4dcf-45d6-aa15-3ca3bfb059c2 req-a39048ad-6d31-4c6c-a74a-4cc131b03654 service nova] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1286.134069] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7607b39-4dcf-45d6-aa15-3ca3bfb059c2 req-a39048ad-6d31-4c6c-a74a-4cc131b03654 service nova] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1286.134182] env[65353]: INFO networking_nsxv3.common.synchronization [req-d7607b39-4dcf-45d6-aa15-3ca3bfb059c2 req-a39048ad-6d31-4c6c-a74a-4cc131b03654 service nova] Enqueued Resource ID: cd99fc87-404b-4af2-8f83-fd0b967442ca with Priority: HIGHEST for action port [ 1286.134586] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_rules [ 1286.134586] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1286.134714] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd99fc87-404b-4af2-8f83-fd0b967442ca with Priority: HIGHEST for action port [ 1286.135204] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.135328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.135395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.135585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.135666] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.136936] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.136990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.137043] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.137207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.137358] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.137451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.137513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.137711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.137780] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.137870] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.138695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd99fc87-404b-4af2-8f83-fd0b967442ca taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.138695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.138820] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.138888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.138960] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd99fc87-404b-4af2-8f83-fd0b967442ca',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.640494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.640665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.640904] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.641944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd99fc87-404b-4af2-8f83-fd0b967442ca with status ACTIVE [ 1286.642225] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.642371] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.642491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.642766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.642929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.643223] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.643372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.643465] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.643715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.643848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.644149] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.644290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.644399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.644617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.644768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.644862] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd99fc87-404b-4af2-8f83-fd0b967442ca is going to be updated. [ 1286.760616] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.760852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.760852] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.761062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.761209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.761374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd99fc87-404b-4af2-8f83-fd0b967442ca" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.147380] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.649809] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.649999] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.650137] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.650384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.650500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.650626] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 is going to be created. [ 1287.676390] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.676390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.676390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.676390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.676390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.685960] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: UNINITIALIZED for 2s [ 1289.698485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: SUCCESS [ 1289.698895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.698975] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.699244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.699469] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.699614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.699717] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.699947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.700068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.700205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.700269] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.202520] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.704452] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de65717-98c6-48f1-a46a-5ef99f79f590: rpc.has_security_group_logging(os_id): False [ 1290.723636] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.723869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.723869] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.724062] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.724156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.724398] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.724498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.724562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.724720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.724790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.724875] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 is going to be created. [ 1290.788494] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.788795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.788795] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.788920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.789098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.800246] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: IN_PROGRESS for 2s [ 1291.136184] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.136353] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1292.714300] env[65353]: INFO networking_nsxv3.common.synchronization [req-a6e9828e-2698-470a-918c-b6cead685399 req-20853727-c073-47cb-bac5-2a3487d295a9 tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1292.714704] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1292.716849] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.716849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.716849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.717067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.717208] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.717324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.717384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.717534] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.717625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.717719] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.813311] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: SUCCESS [ 1292.813549] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.220267] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.220456] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.220494] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.220718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.220810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.221012] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.221141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.221205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.221360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.221438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.221526] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1293.250304] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.250548] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.250644] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.252463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.252463] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.261010] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1295.273077] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1295.273495] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a deletion is rescheduled due to dependency. [ 1295.273495] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.715775] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.715775] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.777344] env[65353]: INFO networking_nsxv3.common.synchronization [req-6d6e6f32-b233-49e1-9eb7-997d79c201d9 req-7302b48f-8f55-4071-92a0-54d57906490e tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1300.777700] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1300.778066] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.778199] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.778264] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.778472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.778771] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.778771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.778771] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.778962] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.779061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.779141] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.058680] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.058902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.059054] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.059313] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.059563] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.059716] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.059828] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.060056] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.060198] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.060407] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1301.060517] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1301.060621] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1301.060726] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1301.060831] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1301.060967] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1301.061114] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1301.080388] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1301.080537] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1301.080669] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1301.080862] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.081226] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-78ea2672-2688-4764-b22f-1c108e33969e taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.081399] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.081520] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.081849] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.081989] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ea2672-2688-4764-b22f-1c108e33969e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.283055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.283279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.283279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.283433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.283523] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.283721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.283823] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.283885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.284045] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.284136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.284261] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1301.307939] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.308144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.308144] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.308328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.308469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.316529] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1301.583989] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.584243] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.584373] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.584656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.584805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.584957] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port 78ea2672-2688-4764-b22f-1c108e33969e not found, creating... [ 1301.585235] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.585390] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.585553] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.585732] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.585877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.586189] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.586370] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.586491] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.586697] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.586830] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.586968] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: 78ea2672-2688-4764-b22f-1c108e33969e is going to be created. [ 1301.608156] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.608374] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.608500] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.608780] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.609450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.609450] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [req-6d6e6f32-b233-49e1-9eb7-997d79c201d9 req-6a27e17f-0270-423b-ac88-c99bfe05c76e service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [req-6d6e6f32-b233-49e1-9eb7-997d79c201d9 req-6a27e17f-0270-423b-ac88-c99bfe05c76e service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [req-6d6e6f32-b233-49e1-9eb7-997d79c201d9 req-6a27e17f-0270-423b-ac88-c99bfe05c76e service nova] Enqueued Resource ID: 78ea2672-2688-4764-b22f-1c108e33969e with Priority: HIGHEST for action port [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1302.301022] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ea2672-2688-4764-b22f-1c108e33969e with Priority: HIGHEST for action port [ 1302.301022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.301906] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.302105] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.302412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.302607] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.303482] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.303592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.303777] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-78ea2672-2688-4764-b22f-1c108e33969e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.303875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.303948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.304123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.304191] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ea2672-2688-4764-b22f-1c108e33969e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.806115] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.806294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.806390] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78ea2672-2688-4764-b22f-1c108e33969e with status ACTIVE [ 1302.806547] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.806656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.806720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.806935] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.807037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.807205] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.807317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.807355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.807502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.807574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.807750] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.807913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.807971] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.808125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.808197] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.808284] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78ea2672-2688-4764-b22f-1c108e33969e is going to be updated. [ 1302.829547] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.829766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.829766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.829919] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.830063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.830220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78ea2672-2688-4764-b22f-1c108e33969e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.327074] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1303.327435] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a deletion is rescheduled due to dependency. [ 1303.327435] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.327590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.327770] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.327994] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.328131] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.328188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.328324] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.328403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.328487] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.831154] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.333999] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.838123] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.838305] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.838425] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.838649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.838649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.838760] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1304.873676] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.873676] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.873972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.873972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.874189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.887558] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1306.898148] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1306.898148] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.898420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.898531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.898727] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.898842] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.898913] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.899084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.899166] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.899251] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.899340] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.300934] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.301168] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1307.401714] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.904288] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a: rpc.has_security_group_logging(os_id): False [ 1307.923354] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.923569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.923625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.923821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.923917] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.924188] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.924290] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.924348] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.924504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.924578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.924664] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1307.982705] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.982923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.982923] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.983149] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.983372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.997632] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1310.011940] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1310.012320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.301908] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.302298] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.302663] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.303165] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.304458] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.304458] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.305634] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.306037] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.787031] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3eda88d-2bee-4208-b02f-81cc532814d8 req-a0e41b2d-8d89-40f6-8f2b-2d7b2cee30d6 tempest-ServerActionsV293TestJSON-615913204 tempest-ServerActionsV293TestJSON-615913204-project-member] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1329.787031] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGHEST for action security_group_members [ 1329.787031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.787031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.787806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.787806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.787806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.787806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.787806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.788233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.788313] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.788416] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.290122] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.290300] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.290349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.290598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.290693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.290891] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.291011] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.291080] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.291234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.291319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.291403] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e is going to be updated. [ 1330.319729] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.319907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.319907] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.320133] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.320273] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.329309] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: IN_PROGRESS for 2s [ 1332.341384] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f60678f1-eecc-4faf-ba97-7a783a30409e in Status: SUCCESS [ 1332.341698] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e deletion is rescheduled due to dependency. [ 1332.341866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.155635] env[65353]: INFO networking_nsxv3.common.synchronization [None req-81cc18d0-c44a-4772-9c39-3de947ffbb4d None None] Enqueued Resource ID: 6fb9b419-1329-48fb-8e78-12281cb2e0de with Priority: HIGHEST for action port [ 1334.155986] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb9b419-1329-48fb-8e78-12281cb2e0de with Priority: HIGHEST for action port [ 1334.156586] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb9b419-1329-48fb-8e78-12281cb2e0de taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.156586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb9b419-1329-48fb-8e78-12281cb2e0de" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.156703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb9b419-1329-48fb-8e78-12281cb2e0de" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.156931] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb9b419-1329-48fb-8e78-12281cb2e0de" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.157031] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb9b419-1329-48fb-8e78-12281cb2e0de',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.661045] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fb9b419-1329-48fb-8e78-12281cb2e0de [ 1334.661174] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.661393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.661393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.661597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.661692] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.661882] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fb9b419-1329-48fb-8e78-12281cb2e0de already deleted. [ 1334.662294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb9b419-1329-48fb-8e78-12281cb2e0de" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.957292] env[65353]: INFO networking_nsxv3.common.synchronization [None req-c747789d-62bf-4635-a1e4-b44808b286ab None None] Enqueued Resource ID: c2b06ab8-2669-4903-bd38-2a668926a340 with Priority: HIGHEST for action port [ 1335.958084] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b06ab8-2669-4903-bd38-2a668926a340 with Priority: HIGHEST for action port [ 1335.958084] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b06ab8-2669-4903-bd38-2a668926a340 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.958342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b06ab8-2669-4903-bd38-2a668926a340" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.958342] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b06ab8-2669-4903-bd38-2a668926a340" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.958503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b06ab8-2669-4903-bd38-2a668926a340" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.958582] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b06ab8-2669-4903-bd38-2a668926a340',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.460678] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2b06ab8-2669-4903-bd38-2a668926a340 [ 1336.460993] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.461121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.461192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.461413] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.461721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.461721] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2b06ab8-2669-4903-bd38-2a668926a340 already deleted. [ 1336.461721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b06ab8-2669-4903-bd38-2a668926a340" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.632675] env[65353]: INFO networking_nsxv3.common.synchronization [req-fe8e74a2-2b4d-4ed4-b5d3-54a51f7acd25 req-bb4aad29-b9dc-451a-87d5-d76ba9ac8830 tempest-ServerAddressesNegativeTestJSON-1724871069 tempest-ServerAddressesNegativeTestJSON-1724871069-project-member] Enqueued Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1339.633350] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1339.633748] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.633897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.633972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.634270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.634457] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.634595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.634666] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.634872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.634995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.635136] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.926222] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.926510] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-158" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.926695] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-158" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.927068] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-158" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.927396] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.927597] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.927758] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.928100] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.928322] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.928562] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1339.928758] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1339.928897] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1339.929033] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1339.929153] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1339.929271] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1339.929401] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.951908] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.952202] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1339.952348] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.952633] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-158" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.953043] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-1150c146-8da6-4416-84de-185c770f64aa taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.953507] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.953595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.953993] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.954170] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1150c146-8da6-4416-84de-185c770f64aa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.138294] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.138514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.138514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.138688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.138782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.138984] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.139102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.139165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.139328] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.139414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.139500] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 already deleted. [ 1340.139580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.457066] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.457288] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.457375] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.457676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.457822] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.457976] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port 1150c146-8da6-4416-84de-185c770f64aa not found, creating... [ 1340.458281] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.458438] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.458555] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.458771] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.458906] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.459204] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.459360] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.459475] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.459676] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.459805] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.459942] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: 1150c146-8da6-4416-84de-185c770f64aa is going to be created. [ 1340.481634] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.481834] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.481955] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.482266] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.482504] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.482731] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.165138] env[65353]: INFO networking_nsxv3.common.synchronization [req-fe8e74a2-2b4d-4ed4-b5d3-54a51f7acd25 req-9b34ea43-8f3a-4d3e-a053-629ee445660e service nova] Enqueued Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_rules [ 1341.165399] env[65353]: INFO networking_nsxv3.common.synchronization [req-fe8e74a2-2b4d-4ed4-b5d3-54a51f7acd25 req-9b34ea43-8f3a-4d3e-a053-629ee445660e service nova] Enqueued Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1341.165503] env[65353]: INFO networking_nsxv3.common.synchronization [req-fe8e74a2-2b4d-4ed4-b5d3-54a51f7acd25 req-9b34ea43-8f3a-4d3e-a053-629ee445660e service nova] Enqueued Resource ID: 1150c146-8da6-4416-84de-185c770f64aa with Priority: HIGHEST for action port [ 1341.165734] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_rules [ 1341.165863] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1341.165958] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1150c146-8da6-4416-84de-185c770f64aa with Priority: HIGHEST for action port [ 1341.166666] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.166790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.166790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.167049] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.167136] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.167937] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.168054] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.168116] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.168330] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.168501] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.168567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.168622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.170498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.170498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.170498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.170498] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-1150c146-8da6-4416-84de-185c770f64aa taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.170498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.170498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.170498] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.170498] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1150c146-8da6-4416-84de-185c770f64aa',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.672721] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.672721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.672948] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.673886] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1150c146-8da6-4416-84de-185c770f64aa with status ACTIVE [ 1341.673971] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.674145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.674145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.674355] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.674451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.674638] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.674701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.674764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.674895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.675035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.675157] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.675244] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.675303] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.675439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.675509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.675587] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1150c146-8da6-4416-84de-185c770f64aa is going to be updated. [ 1341.697618] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.697836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.697836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.698029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.698181] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.698614] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1150c146-8da6-4416-84de-185c770f64aa" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.175221] env[65353]: INFO networking_nsxv3.common.synchronization [None req-a9cf8c98-ba77-4463-a854-6549d4cb140d tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1342.175737] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1342.176037] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.176229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.176452] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.176724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.176828] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.177741] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.246354] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b27e11af-0bbf-4284-b812-bbc5ee0948e7 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1342.246895] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1342.247181] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.247274] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.680179] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.680368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.680480] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.680773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.680898] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.681040] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 is going to be created. [ 1342.704905] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.705083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.705136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.705361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.705455] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.705558] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 already deleted. [ 1342.705641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.705786] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.705933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.706041] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.708911] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.709052] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.709099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.709284] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.709590] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.719896] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: UNINITIALIZED for 2s [ 1343.227793] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.228201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.228201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.228201] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.228372] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.228409] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 already deleted. [ 1343.228478] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.729611] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: SUCCESS [ 1344.729969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.729969] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.730202] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.730399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.730515] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.730580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.730729] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.730809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.730892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.730980] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.233697] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.233908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.233908] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.234179] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.234353] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.234454] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.234517] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.234663] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.234750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.234839] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.235029] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.235145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.235208] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.235354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.235493] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.235583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.235641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.235773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.235848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.235927] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.236027] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.738692] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f2e28ea-bf82-481a-ade4-549ebae6fbc3: rpc.has_security_group_logging(os_id): False [ 1345.760031] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.760031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.760031] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.760258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.760258] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.760432] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.760513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.760581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.760730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.760803] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.760986] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.761094] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.761151] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.761283] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.761352] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.761531] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.761619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.761659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.761788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.761854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.761935] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 is going to be created. [ 1345.818358] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.818630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.818630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.818849] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.819055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.829853] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: IN_PROGRESS for 2s [ 1347.247992] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.247992] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1347.651488] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3b02a65-1f29-4cf6-a86b-0afa11b77792 req-1d714832-3a88-4e8b-8e59-a14b9b533e5b tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1347.651488] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1347.651645] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.651701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.651764] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.651990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.652274] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.652397] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.652720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.652720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.652720] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.652854] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.843051] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: SUCCESS [ 1347.843282] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.953139] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.953369] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.953517] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.953819] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.954116] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.954278] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.954388] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.954617] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.954771] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.955161] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1347.955354] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1347.955432] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1347.955539] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1347.955708] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1347.955847] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1347.955990] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1347.976845] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1347.977110] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1347.977277] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1347.977484] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.977859] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-c9a58f1d-c549-4acb-8c82-6107d28c371c taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.978053] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.978175] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.978591] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.978731] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a58f1d-c549-4acb-8c82-6107d28c371c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.156759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.156929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.156929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.157126] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.157217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.157418] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.157522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.157635] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.157726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.157939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.157939] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 already deleted. [ 1348.157939] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.481272] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.481610] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.481654] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.481906] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.482074] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.482230] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port c9a58f1d-c549-4acb-8c82-6107d28c371c not found, creating... [ 1348.482587] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.482812] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.482939] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.483241] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.483443] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.483756] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.483913] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.484082] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.484344] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.484484] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.484624] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: c9a58f1d-c549-4acb-8c82-6107d28c371c is going to be created. [ 1348.506141] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.506706] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.507098] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.507447] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.507704] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.507959] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.203937] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3b02a65-1f29-4cf6-a86b-0afa11b77792 req-e7b90883-876a-497b-9ff8-8f8cb0633beb service nova] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1349.204131] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3b02a65-1f29-4cf6-a86b-0afa11b77792 req-e7b90883-876a-497b-9ff8-8f8cb0633beb service nova] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1349.204268] env[65353]: INFO networking_nsxv3.common.synchronization [req-b3b02a65-1f29-4cf6-a86b-0afa11b77792 req-e7b90883-876a-497b-9ff8-8f8cb0633beb service nova] Enqueued Resource ID: c9a58f1d-c549-4acb-8c82-6107d28c371c with Priority: HIGHEST for action port [ 1349.204489] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_rules [ 1349.204616] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1349.204706] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a58f1d-c549-4acb-8c82-6107d28c371c with Priority: HIGHEST for action port [ 1349.205263] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.205406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.205475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.205672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.205756] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.206568] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.206693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.206761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.206892] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.207043] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.207130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.207270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.207326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.207419] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.207517] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.209157] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9a58f1d-c549-4acb-8c82-6107d28c371c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.209157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.209157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.209157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.209157] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a58f1d-c549-4acb-8c82-6107d28c371c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.711121] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.711574] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.711574] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9a58f1d-c549-4acb-8c82-6107d28c371c with status ACTIVE [ 1349.711657] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.711748] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.711817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.712127] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.712220] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.712473] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.712531] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.712581] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.712854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.712854] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.712980] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.713098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.713173] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.713334] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.713411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.713522] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9a58f1d-c549-4acb-8c82-6107d28c371c is going to be updated. [ 1349.714705] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.737609] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.737809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.737809] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.738024] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.738174] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.738354] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9a58f1d-c549-4acb-8c82-6107d28c371c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.217225] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.720053] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.720053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.720053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.720053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.720053] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.720527] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 is going to be created. [ 1350.743313] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.743488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.743488] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.743685] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.743848] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.752304] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: UNINITIALIZED for 2s [ 1351.016828] env[65353]: INFO networking_nsxv3.common.synchronization [req-4e0da966-50cf-4d0f-bbad-03e7b0961d95 req-0a507fc4-db6b-4773-ac05-0aba4a8455c7 tempest-ServerAddressesNegativeTestJSON-1724871069 tempest-ServerAddressesNegativeTestJSON-1724871069-project-member] Enqueued Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1351.017478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGHEST for action security_group_members [ 1351.017984] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.018087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.018130] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.018403] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.018555] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.018684] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.018765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.018949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.019071] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.019201] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.521242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.521431] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.521473] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.521758] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.521889] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.522126] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.522261] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.522347] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.522544] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.522643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.522751] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 is going to be updated. [ 1351.549350] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.549575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.549575] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.549888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.550055] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.558959] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: IN_PROGRESS for 2s [ 1352.763591] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: SUCCESS [ 1352.763951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.763951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.764035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.764249] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.764376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.764376] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.764489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.764569] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.764693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.764749] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.267304] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.568348] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 in Status: SUCCESS [ 1353.568588] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 deletion is rescheduled due to dependency. [ 1353.568703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.770441] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7173c74-e718-4fb3-b848-53964fb8e953: rpc.has_security_group_logging(os_id): False [ 1353.789280] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.789486] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.789535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.789737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.789833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.790104] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.790206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.790271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.790423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.790500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.790586] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 is going to be created. [ 1353.848799] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.848994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.848994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.849229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.849439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.859455] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: IN_PROGRESS for 2s [ 1355.878403] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: SUCCESS [ 1355.878977] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.018880] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.019073] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.020021] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.020408] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.021768] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.022082] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.023401] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.023795] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.024807] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.025166] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.782910] env[65353]: INFO networking_nsxv3.common.synchronization [req-c4f1a853-ca37-4482-99f4-3d7323ef84b2 req-455c70dc-b3a0-4385-8e06-e7f767643c62 tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1378.783688] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1378.784220] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.784325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.784377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.784593] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.784753] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.784877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.784924] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.785108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.785194] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.785296] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.288178] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.288394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.288394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.288641] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.288777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.288983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.289102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.289165] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.289317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.289423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.289512] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1379.316021] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.316230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.316230] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.316418] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.316554] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.324388] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1381.334449] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1381.334891] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a deletion is rescheduled due to dependency. [ 1381.334891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.785311] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.785704] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.734899] env[65353]: INFO networking_nsxv3.common.synchronization [req-078f0f17-d103-4ea8-a5f1-27ecca3c1ed8 req-5c421338-b80c-480f-a104-d8136318d69a tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1385.735436] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1385.735733] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.735844] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.735911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.736260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.736427] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.736529] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.736622] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.736749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.736832] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.736924] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.028333] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.028569] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.028693] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.029013] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.029275] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.029467] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.029595] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.029814] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.029969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.030187] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1386.030303] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1386.030412] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1386.030545] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1386.030666] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1386.030772] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1386.030903] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1386.052578] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1386.052776] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1386.052912] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1386.053156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.053529] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-c5cf457e-0b28-4eec-b32d-021d34f715a0 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.053732] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.053897] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.054295] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.054427] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cf457e-0b28-4eec-b32d-021d34f715a0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.242146] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.242350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.242399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.242599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.242693] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.242983] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.243134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.243205] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.243361] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.243436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.243525] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1386.269243] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.269436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.269436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.269617] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.269785] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.277568] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1386.557060] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.557300] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.557426] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.557701] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.557851] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.558021] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port c5cf457e-0b28-4eec-b32d-021d34f715a0 not found, creating... [ 1386.558274] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.558428] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.558542] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.558764] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.558896] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.559192] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.559344] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.559456] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.559656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.559787] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.559923] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: c5cf457e-0b28-4eec-b32d-021d34f715a0 is going to be created. [ 1386.579640] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.579879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.579985] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.580263] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.580486] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.580698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.262100] env[65353]: INFO networking_nsxv3.common.synchronization [req-078f0f17-d103-4ea8-a5f1-27ecca3c1ed8 req-bfcb26d6-babb-4b00-940d-118fbe5e4372 service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1387.262100] env[65353]: INFO networking_nsxv3.common.synchronization [req-078f0f17-d103-4ea8-a5f1-27ecca3c1ed8 req-bfcb26d6-babb-4b00-940d-118fbe5e4372 service nova] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1387.262100] env[65353]: INFO networking_nsxv3.common.synchronization [req-078f0f17-d103-4ea8-a5f1-27ecca3c1ed8 req-bfcb26d6-babb-4b00-940d-118fbe5e4372 service nova] Enqueued Resource ID: c5cf457e-0b28-4eec-b32d-021d34f715a0 with Priority: HIGHEST for action port [ 1387.262478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_rules [ 1387.262478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1387.262478] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cf457e-0b28-4eec-b32d-021d34f715a0 with Priority: HIGHEST for action port [ 1387.262759] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.262878] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.262947] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.263400] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.263491] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.264914] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.264914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.265150] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5cf457e-0b28-4eec-b32d-021d34f715a0 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.265150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.265150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.267104] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.267104] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cf457e-0b28-4eec-b32d-021d34f715a0',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.768691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.768925] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.769080] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5cf457e-0b28-4eec-b32d-021d34f715a0 with status ACTIVE [ 1387.769252] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.769360] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.769423] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.769624] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.769715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.770081] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.770081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.770081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.770359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.770359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.770451] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.771044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.771044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.771044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.771044] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.771044] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5cf457e-0b28-4eec-b32d-021d34f715a0 is going to be updated. [ 1387.791058] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.791250] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.791294] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.791451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.791586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.791740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5cf457e-0b28-4eec-b32d-021d34f715a0" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.288596] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1388.289025] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a deletion is rescheduled due to dependency. [ 1388.289025] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.289107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.289288] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.289473] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.289584] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.289649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.289812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.289897] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.289992] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.792532] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.294677] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.797011] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.797206] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.797285] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.797501] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.797589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.797686] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1389.826679] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.826875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.826950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.827135] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.827281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.836429] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1391.848107] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1391.848580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.848580] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.848765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.848864] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.849030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.849128] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.849204] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.849271] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.849353] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.849443] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.263204] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.263473] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1392.352114] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.855215] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a: rpc.has_security_group_logging(os_id): False [ 1392.881698] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.881966] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.882067] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.882432] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.882619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.883117] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.883335] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.883459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.883704] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.883825] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.883959] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1392.965175] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.965412] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.965462] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.965654] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.965806] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.979062] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1394.994843] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1394.995141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.264400] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.264664] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.497975] env[65353]: INFO networking_nsxv3.common.synchronization [req-463aaa8d-bbf0-4b5d-b6fe-6d85a3a4b12a req-c6320702-95eb-4f8d-aa12-b697c9c6e165 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1397.498208] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGHEST for action security_group_members [ 1397.498511] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.498632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.498698] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.498956] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.499127] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.499229] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.499291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.499442] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.499527] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.499619] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.004611] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.004813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.004813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.005041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.005142] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.005347] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.005451] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.005514] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.005672] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.005750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.005838] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 is going to be updated. [ 1398.034018] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.034234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.034234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.034420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.034564] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.042854] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: IN_PROGRESS for 2s [ 1400.054043] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7173c74-e718-4fb3-b848-53964fb8e953 in Status: SUCCESS [ 1400.054438] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 deletion is rescheduled due to dependency. [ 1400.054438] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.499686] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.500197] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.501017] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.501270] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.745502] env[65353]: INFO networking_nsxv3.common.synchronization [req-db808216-7f02-47b0-9fa1-08f5990b1e86 req-f6d9ab94-309c-4568-96a7-140aa1232552 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1408.745782] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGHEST for action security_group_members [ 1408.745911] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.746039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.746109] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.746301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.746451] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.746542] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.746599] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.746737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.747344] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.747344] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.249532] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.249781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.249781] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.249963] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.250107] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.250265] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.250357] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.250420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.250571] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.250645] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.250730] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 is going to be updated. [ 1409.280165] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.280389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.280389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.280596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.280737] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.289195] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: IN_PROGRESS for 2s [ 1411.299901] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 in Status: SUCCESS [ 1411.299901] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 deletion is rescheduled due to dependency. [ 1411.299901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.410505] env[65353]: INFO networking_nsxv3.common.synchronization [None req-13f6c6a4-9834-4d4f-82c6-00505ae5ee44 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1413.411337] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1413.411655] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.411777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.411846] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.412122] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.412207] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.489978] env[65353]: INFO networking_nsxv3.common.synchronization [None req-9d43b687-c322-4ce7-bd6b-842ba7b24d37 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1413.490475] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1413.490778] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.490880] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.935186] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.935350] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.935401] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.935607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.935681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.935777] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 already deleted. [ 1413.935864] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.936034] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.936233] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.936314] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.455173] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.455594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.455594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.455594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.455713] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.455758] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 already deleted. [ 1414.455831] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.492934] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.492934] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.778410] env[65353]: INFO networking_nsxv3.common.synchronization [req-6a3107c2-143d-42b8-ac95-fa5a22326d73 req-3ca6067e-137f-4a74-a7b4-e3607384d25b tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1418.778850] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1418.779328] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.779449] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.779513] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.779744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.779900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.780013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.780099] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.780393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.780393] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.780393] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.050554] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.050746] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.050869] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.051142] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.051404] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.051551] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.051665] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.051877] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.052146] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.052401] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1419.052522] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1419.052631] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1419.052738] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1419.052845] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1419.052949] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1419.053092] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1419.072240] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1419.072413] env[65353]: DEBUG dogpile.cache.region [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1419.072514] env[65353]: DEBUG dogpile.lock [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1419.072677] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.073018] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.073156] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.073276] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.073582] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.073720] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd6681a6-637a-4dc6-98c3-03ee79a22ee3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.282286] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.282525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.282525] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.282740] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.282833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.283049] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.283150] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.283212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.283364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.283439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.283524] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 already deleted. [ 1419.283601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.575958] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.576352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.576352] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.576541] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.576698] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.576851] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Segment Port cd6681a6-637a-4dc6-98c3-03ee79a22ee3 not found, creating... [ 1419.577191] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.577372] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.577514] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.577763] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.577902] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.578209] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.578368] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.578481] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.578687] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.578816] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.578954] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Resource: SegmentPort with ID: cd6681a6-637a-4dc6-98c3-03ee79a22ee3 is going to be created. [ 1419.598788] env[65353]: DEBUG networking_nsxv3.common.locking [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.598994] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.599165] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.599434] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.599656] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.599873] env[65353]: DEBUG oslo_concurrency.lockutils [None req-e2f2eb12-c746-4318-b0ac-f8703b242867 None None] Releasing lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.272679] env[65353]: INFO networking_nsxv3.common.synchronization [req-6a3107c2-143d-42b8-ac95-fa5a22326d73 req-aae48aea-4721-4187-b54f-3adbd4745b44 service nova] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1420.272869] env[65353]: INFO networking_nsxv3.common.synchronization [req-6a3107c2-143d-42b8-ac95-fa5a22326d73 req-aae48aea-4721-4187-b54f-3adbd4745b44 service nova] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1420.272992] env[65353]: INFO networking_nsxv3.common.synchronization [req-6a3107c2-143d-42b8-ac95-fa5a22326d73 req-aae48aea-4721-4187-b54f-3adbd4745b44 service nova] Enqueued Resource ID: cd6681a6-637a-4dc6-98c3-03ee79a22ee3 with Priority: HIGHEST for action port [ 1420.273240] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_rules [ 1420.273427] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1420.273460] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd6681a6-637a-4dc6-98c3-03ee79a22ee3 with Priority: HIGHEST for action port [ 1420.273972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.274156] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.274224] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.274427] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.274521] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.275308] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.275420] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.275485] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.275643] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.275785] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.275875] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.275937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.276098] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.276216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.276266] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.276972] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.277111] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.277157] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.277281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.277352] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd6681a6-637a-4dc6-98c3-03ee79a22ee3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.778995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.779443] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.780536] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.782279] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd6681a6-637a-4dc6-98c3-03ee79a22ee3 with status ACTIVE [ 1420.782279] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.782279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.782279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.782279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.782279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.782496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.782496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.782496] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.782677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.782718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.782865] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.782955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.783037] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.783163] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.783221] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.783307] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd6681a6-637a-4dc6-98c3-03ee79a22ee3 is going to be updated. [ 1420.805692] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.805909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.805909] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.806103] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.806241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.806394] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd6681a6-637a-4dc6-98c3-03ee79a22ee3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.285886] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.789035] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.789035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.789035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.789035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.789035] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.789554] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 is going to be created. [ 1421.812642] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.812777] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.812845] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.813061] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.813263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.825598] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: UNINITIALIZED for 2s [ 1423.836158] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: SUCCESS [ 1423.836651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.836651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.836782] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.836964] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.837125] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.837190] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.837363] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.837436] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.837522] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.837614] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.340239] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.844153] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ba94272-d78f-4134-9d3d-0c406f534ff8: rpc.has_security_group_logging(os_id): False [ 1424.862437] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.862718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.862718] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.862836] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.862929] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.863194] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.863291] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.863349] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.863500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.863586] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.863634] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 is going to be created. [ 1424.931600] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.931600] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.931857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.931857] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.933026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.943874] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: IN_PROGRESS for 2s [ 1425.274627] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.274810] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1426.957109] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: SUCCESS [ 1426.957502] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.276398] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.276756] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.277501] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.277501] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.278807] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.279151] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.280408] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.280770] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.937679] env[65353]: INFO networking_nsxv3.common.synchronization [req-0958c5a8-0c16-4308-a0a7-996e1d76b6d6 req-d58ee579-9ec4-4e71-878e-40b61875718f tempest-ServerActionsTestJSON-1098095052 tempest-ServerActionsTestJSON-1098095052-project-member] Enqueued Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1447.938829] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a with Priority: HIGHEST for action security_group_members [ 1447.938829] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.938829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.938829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.938829] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.939134] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.939503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.939579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.939730] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.939812] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.940193] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ea3edd-9280-4ba2-b412-ca1c1ac57a2a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.441762] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.441993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.441993] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.442214] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.442358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.442572] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.442681] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.442756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.442900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.442978] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.443082] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a is going to be updated. [ 1448.469242] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.469466] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.469509] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.469680] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.469821] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.477732] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: IN_PROGRESS for 2s [ 1450.488348] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a in Status: SUCCESS [ 1450.488794] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ea3edd-9280-4ba2-b412-ca1c1ac57a2a deletion is rescheduled due to dependency. [ 1450.488794] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ea3edd-9280-4ba2-b412-ca1c1ac57a2a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.939424] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.939799] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.940450] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.940450] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.942322] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.942724] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.943704] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.943704] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.945095] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.945448] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.946602] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.946948] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.330627] env[65353]: INFO networking_nsxv3.common.synchronization [req-1861cff1-c121-4e38-988e-31debc4f70f8 req-13ac80ee-a775-440e-888f-2d37f70f1538 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1480.331065] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 with Priority: HIGHEST for action security_group_members [ 1480.331380] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ba94272-d78f-4134-9d3d-0c406f534ff8 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.331500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.331567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.331779] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.331962] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.332123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.332123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.332267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.332332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.332423] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ba94272-d78f-4134-9d3d-0c406f534ff8',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.835121] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.835121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.835121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.835121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.835121] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.835121] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.835532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.835532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.835532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.835532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.835532] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 is going to be updated. [ 1480.868657] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.868972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.868972] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.869075] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.869184] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.878138] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: IN_PROGRESS for 2s [ 1482.888961] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 in Status: SUCCESS [ 1482.888961] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ba94272-d78f-4134-9d3d-0c406f534ff8 deletion is rescheduled due to dependency. [ 1482.888961] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ba94272-d78f-4134-9d3d-0c406f534ff8" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.148865] env[65353]: INFO networking_nsxv3.common.synchronization [None req-3736fe0c-6bd8-4c12-8ecc-58d2df3b9d63 tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1485.149389] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1485.149717] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.149833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.149948] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.150167] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.150251] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.230982] env[65353]: INFO networking_nsxv3.common.synchronization [None req-b232a54f-f4cd-472c-adb5-6a36b7fa108e tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1485.231169] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1485.231761] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.231872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.673269] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.673535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.673535] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.673873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.674017] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.674157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e already deleted. [ 1485.674281] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.674500] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.674725] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.674853] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.195319] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.195695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.195695] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.195766] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.195862] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.195910] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e already deleted. [ 1486.195997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.232246] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.232652] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.607594] env[65353]: INFO networking_nsxv3.common.synchronization [req-689febcc-9f79-46f5-9fb0-2e8fb0fe4942 req-6192ab4a-5dd2-427f-b909-a2d9313a1dbe tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1490.608160] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1490.608464] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.608582] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.608649] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.608895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.609055] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.609399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.609399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.609399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.609598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.609598] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.863281] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.863488] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.863610] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.863898] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.864164] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.864318] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.864432] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.864659] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.864833] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.865065] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1490.865180] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] NeedRegenerationException {{(pid=65353) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1490.865287] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] no value, waiting for create lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1490.865390] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] value creation lock acquired {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1490.865496] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] No value present for key: 'zone-id' {{(pid=65353) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1490.865602] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Calling creation function for not-yet-present value {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1490.865730] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1490.888397] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1490.888579] env[65353]: DEBUG dogpile.cache.region [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65353) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1490.888675] env[65353]: DEBUG dogpile.lock [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Released creation lock {{(pid=65353) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1490.888849] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "network-293" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.889222] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock port-feda661e-f659-4177-8946-f77319c48f96 taken with stack trace [, , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.889399] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.889519] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.889901] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.890059] env[65353]: DEBUG networking_nsxv3.api.rpc [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feda661e-f659-4177-8946-f77319c48f96',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.111695] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.111918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.111918] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.112108] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.112192] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.112366] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.112479] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.112550] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.112677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.112746] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.112826] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e already deleted. [ 1491.112922] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.392427] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.392850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.392850] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.392969] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.393126] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.393277] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Segment Port feda661e-f659-4177-8946-f77319c48f96 not found, creating... [ 1491.393530] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.393682] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.393794] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.394015] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.394155] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.394427] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.394574] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.394684] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.394879] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.395017] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.395154] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Resource: SegmentPort with ID: feda661e-f659-4177-8946-f77319c48f96 is going to be created. [ 1491.414230] env[65353]: DEBUG networking_nsxv3.common.locking [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.414445] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.414494] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.414734] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.414957] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.415192] env[65353]: DEBUG oslo_concurrency.lockutils [None req-d7bb26a2-e059-44ce-90c5-6518fc805a94 None None] Releasing lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.100462] env[65353]: INFO networking_nsxv3.common.synchronization [req-689febcc-9f79-46f5-9fb0-2e8fb0fe4942 req-7bb59b17-bc08-4bd8-bef7-0c45302300fb service nova] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1492.100634] env[65353]: INFO networking_nsxv3.common.synchronization [req-689febcc-9f79-46f5-9fb0-2e8fb0fe4942 req-7bb59b17-bc08-4bd8-bef7-0c45302300fb service nova] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1492.100790] env[65353]: INFO networking_nsxv3.common.synchronization [req-689febcc-9f79-46f5-9fb0-2e8fb0fe4942 req-7bb59b17-bc08-4bd8-bef7-0c45302300fb service nova] Enqueued Resource ID: feda661e-f659-4177-8946-f77319c48f96 with Priority: HIGHEST for action port [ 1492.101312] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_rules [ 1492.101449] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1492.101547] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feda661e-f659-4177-8946-f77319c48f96 with Priority: HIGHEST for action port [ 1492.101866] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.101920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.101982] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.102267] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.102304] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.103139] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.103252] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.103319] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.103483] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.103669] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.103721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.103761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.103902] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.103990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.104098] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.105164] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock port-feda661e-f659-4177-8946-f77319c48f96 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.105277] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.105343] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.105493] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.105567] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feda661e-f659-4177-8946-f77319c48f96',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.608030] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.608030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.608030] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.608551] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feda661e-f659-4177-8946-f77319c48f96 with status ACTIVE [ 1492.608760] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.608760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.608893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.609084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.609084] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.609259] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.609346] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.609409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.609557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.609630] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.609842] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.609950] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.610020] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.610161] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.610232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.610317] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feda661e-f659-4177-8946-f77319c48f96 is going to be updated. [ 1492.633105] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.633268] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.633317] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.633518] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.633652] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.633811] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feda661e-f659-4177-8946-f77319c48f96" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.112459] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.614808] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.615266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.615266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.615266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.615370] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.615501] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e is going to be created. [ 1493.638216] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.638519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.638519] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.638656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.638776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.648552] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: UNINITIALIZED for 2s [ 1495.659619] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: SUCCESS [ 1495.660106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.660106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.660242] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.660421] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.660540] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.660606] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.660765] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.660888] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.660937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.661045] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.163631] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.666113] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eed4a972-98a5-4a44-9e59-8823c9af364e: rpc.has_security_group_logging(os_id): False [ 1496.684026] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.684228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.684228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.684383] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.684472] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.684712] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.684813] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.684877] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.685039] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.685117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.685201] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e is going to be created. [ 1496.742945] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.743231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.743231] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.743379] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.743598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.755781] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: IN_PROGRESS for 2s [ 1497.102746] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.102877] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1498.770072] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: SUCCESS [ 1498.770489] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.104125] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.104535] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.105139] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.105651] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.201920] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1510.202401] env[65353]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b2197ae1-6c51-4749-b173-5d853217d5dd None None] NSXv3 Agent Agent loop - iteration:4 started [ 1512.106656] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.106656] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.120460] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.120896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.120896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.120896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.121089] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.623683] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.126023] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.628308] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1516.628515] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1517.107031] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.107130] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.362298] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.362703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.362703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.362703] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.375349] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1517.376246] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.377146] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1517.414878] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.415120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.415120] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.415307] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.429041] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.429779] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1517.429855] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1517.429944] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1517.463068] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.463068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.463068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.463068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.463594] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.463756] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1517.533797] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.534070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.534070] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.534270] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.534595] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.534862] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1517.605129] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.605433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.605433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.605563] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.605863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.606167] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:28. [ 1517.606256] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fc6d712f-e111-4ee3-8ed1-729c0a27074b', '7f2e28ea-bf82-481a-ade4-549ebae6fbc3', 'f60678f1-eecc-4faf-ba97-7a783a30409e', '3469e958-4a31-4f2a-987e-042bbed3a4ae', 'eed4a972-98a5-4a44-9e59-8823c9af364e', 'a7173c74-e718-4fb3-b848-53964fb8e953', '2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff', '4fb5d077-5aae-475f-9ce6-a007397ccf52', '8de65717-98c6-48f1-a46a-5ef99f79f590', 'ff847f4a-e188-46a1-bbea-b7ce5960a51a', 'f70850f2-6628-4be4-939e-95e5fadec74b', '45e4fdd1-656b-4cc6-ba66-7fc4257c0446', '4ef686cd-78eb-46c8-a0b8-b56b7873d69d', '0bceb08f-d9a1-4677-8b2e-0aeacfbbb531', 'e5fbec70-0464-48ee-8744-b368faac3797', '1a2987c0-489b-45df-9694-cf09b0682b7c', 'dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad', 'eef90e1f-f512-4c74-82f2-c918b64f5aee', 'cadcc6df-baac-43fd-bf48-5485c0b69d95', '101d7123-33df-4206-98ea-c31321fdee80', '66ea3edd-9280-4ba2-b412-ca1c1ac57a2a', 'e0209ced-141c-4ff9-b95c-1f2fc770b1f0', '357b71ae-4236-49a4-9cb3-5cec4c42e443', 'b9972817-ff77-432f-a5cd-8388f88bd29a', '187f3f5f-bc20-47f0-a9c3-7ddd424c5dc5', 'e9cb80b2-00dd-48f3-aba0-08eecbed0594', 'e8cbd2fb-a386-46ba-9054-c04ccc0a46d9', '3ba94272-d78f-4134-9d3d-0c406f534ff8'} {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1517.606356] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1517.623579] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.623743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.623743] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.623915] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.624010] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.624157] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1517.624241] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1517.624314] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1517.697996] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.698234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.698234] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.698433] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.699642] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.699921] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1517.700045] env[65353]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65353) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1517.700111] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1517.700183] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1517.700262] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/28 resources of Type:Security Group Rules [ 1517.700331] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGH for action security_group_rules [ 1517.700432] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGH for action security_group_rules [ 1517.700467] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGH for action security_group_rules [ 1517.700537] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGH for action security_group_rules [ 1517.700589] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGH for action security_group_rules [ 1517.700644] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGH for action security_group_rules [ 1517.700696] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGH for action security_group_rules [ 1517.700753] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGH for action security_group_rules [ 1517.700812] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGH for action security_group_rules [ 1517.700864] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGH for action security_group_rules [ 1517.700919] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGH for action security_group_rules [ 1517.701014] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGH for action security_group_rules [ 1517.701130] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGH for action security_group_rules [ 1517.701228] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGH for action security_group_rules [ 1517.701288] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGH for action security_group_rules [ 1517.701345] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGH for action security_group_rules [ 1517.701396] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGH for action security_group_rules [ 1517.701448] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGH for action security_group_rules [ 1517.701511] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGH for action security_group_rules [ 1517.701569] env[65353]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGH for action security_group_rules [ 1517.701665] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.108439] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.108795] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1522.108795] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b with Priority: HIGH for action security_group_rules [ 1522.108795] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60678f1-eecc-4faf-ba97-7a783a30409e with Priority: HIGH for action security_group_rules [ 1522.108981] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff with Priority: HIGH for action security_group_rules [ 1522.108981] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fbec70-0464-48ee-8744-b368faac3797 with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101d7123-33df-4206-98ea-c31321fdee80 with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef90e1f-f512-4c74-82f2-c918b64f5aee with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2987c0-489b-45df-9694-cf09b0682b7c with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70850f2-6628-4be4-939e-95e5fadec74b with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a with Priority: HIGH for action security_group_rules [ 1522.110035] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 with Priority: HIGH for action security_group_rules [ 1522.110480] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7173c74-e718-4fb3-b848-53964fb8e953 with Priority: HIGH for action security_group_rules [ 1522.110480] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 with Priority: HIGH for action security_group_rules [ 1522.110480] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGH for action security_group_rules [ 1522.110480] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 with Priority: HIGH for action security_group_rules [ 1522.110609] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae with Priority: HIGH for action security_group_rules [ 1522.110861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.110995] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.111083] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.111301] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.111383] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6d712f-e111-4ee3-8ed1-729c0a27074b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.112861] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f60678f1-eecc-4faf-ba97-7a783a30409e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.112861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.112861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.113072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.113072] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f60678f1-eecc-4faf-ba97-7a783a30409e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.113894] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.114760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.114760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.114760] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.114760] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.116620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5fbec70-0464-48ee-8744-b368faac3797 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.116620] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5fbec70-0464-48ee-8744-b368faac3797',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.116620] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-101d7123-33df-4206-98ea-c31321fdee80 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.116620] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.116620] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('101d7123-33df-4206-98ea-c31321fdee80',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.118060] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cadcc6df-baac-43fd-bf48-5485c0b69d95 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.118145] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.118189] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.118331] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.118439] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cadcc6df-baac-43fd-bf48-5485c0b69d95',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.119109] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef90e1f-f512-4c74-82f2-c918b64f5aee taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.119735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.119735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.119735] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.119735] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef90e1f-f512-4c74-82f2-c918b64f5aee',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.120219] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.120326] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.120598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.120598] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.120598] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.121373] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.122106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.122106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.122106] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.122106] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bceb08f-d9a1-4677-8b2e-0aeacfbbb531',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.122895] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2987c0-489b-45df-9694-cf09b0682b7c taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.122895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.122895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.122895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.122895] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2987c0-489b-45df-9694-cf09b0682b7c',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.123399] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.123504] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.123562] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.123721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.123784] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ef686cd-78eb-46c8-a0b8-b56b7873d69d',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.124450] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.124557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.124677] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.124773] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.124847] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45e4fdd1-656b-4cc6-ba66-7fc4257c0446',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.125597] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f70850f2-6628-4be4-939e-95e5fadec74b taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.125716] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.125788] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.125896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.125963] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f70850f2-6628-4be4-939e-95e5fadec74b',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.126656] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.126761] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.126827] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.127030] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.127137] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff847f4a-e188-46a1-bbea-b7ce5960a51a',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.127884] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de65717-98c6-48f1-a46a-5ef99f79f590 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.127986] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.128087] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.128212] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.128356] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de65717-98c6-48f1-a46a-5ef99f79f590',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.130441] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7173c74-e718-4fb3-b848-53964fb8e953 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.130556] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.130601] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.130749] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.130819] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7173c74-e718-4fb3-b848-53964fb8e953',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.131537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb5d077-5aae-475f-9ce6-a007397ccf52 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.131711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.131711] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.131841] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.131911] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb5d077-5aae-475f-9ce6-a007397ccf52',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.132872] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.132872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.132872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.133068] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.133068] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.133623] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3 taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.133724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.133791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.133937] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.134017] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e28ea-bf82-481a-ade4-549ebae6fbc3',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.134767] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3469e958-4a31-4f2a-987e-042bbed3a4ae taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.134873] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.134949] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.135532] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.135532] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3469e958-4a31-4f2a-987e-042bbed3a4ae',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.163822] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.163997] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.164060] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.164249] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.166238] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.166387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.179185] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.179399] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.196469] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.196703] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5fbec70-0464-48ee-8744-b368faac3797 is going to be deleted. [ 1522.197530] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.198027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.213280] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.213406] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6d712f-e111-4ee3-8ed1-729c0a27074b is going to be deleted. [ 1522.214207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.214416] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.231810] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.231958] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f60678f1-eecc-4faf-ba97-7a783a30409e is going to be deleted. [ 1522.257349] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.257585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.257585] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.257790] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.257911] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.258081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5fbec70-0464-48ee-8744-b368faac3797" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.258840] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.258955] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.259032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.259207] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.259289] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.259389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6d712f-e111-4ee3-8ed1-729c0a27074b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.280958] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.281218] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.281325] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.281636] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.281756] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.281920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f60678f1-eecc-4faf-ba97-7a783a30409e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.640933] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.641245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.641245] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.641387] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.641517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.641604] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.641675] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.641843] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.641930] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.642056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.642106] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.691557] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.691872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.691872] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.691951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.700537] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.700750] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.701517] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.701625] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.702293] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.702395] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.703137] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.703228] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.703902] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.703994] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.704709] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.704807] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.705956] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.706050] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.706797] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.706894] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.707900] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.708019] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.708691] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.708783] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.709363] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.709803] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.709896] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.710525] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.710906] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.711012] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.711574] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.711968] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.712097] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.712731] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.713127] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.713209] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.713817] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.714184] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.714275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.714839] env[65353]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.715259] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.715384] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f70850f2-6628-4be4-939e-95e5fadec74b is going to be deleted. [ 1522.716232] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.716541] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.733134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.733287] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff847f4a-e188-46a1-bbea-b7ce5960a51a is going to be deleted. [ 1522.734154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.734359] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.753893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.754066] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cadcc6df-baac-43fd-bf48-5485c0b69d95 is going to be deleted. [ 1522.754853] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.755063] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.772139] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.772339] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.777358] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.777485] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 101d7123-33df-4206-98ea-c31321fdee80 is going to be deleted. [ 1522.778390] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.778597] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.788901] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.789102] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.798526] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.798686] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ef686cd-78eb-46c8-a0b8-b56b7873d69d is going to be deleted. [ 1522.799583] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.799791] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.811212] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.811439] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.825838] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.825981] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de65717-98c6-48f1-a46a-5ef99f79f590 is going to be deleted. [ 1522.826861] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.827186] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.829180] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.829279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.860503] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.860687] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff is going to be deleted. [ 1522.861619] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.861833] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.894724] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.895036] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.934851] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.935053] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb5d077-5aae-475f-9ce6-a007397ccf52 is going to be deleted. [ 1522.935885] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.936188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.969075] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.969292] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.996216] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.996398] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bceb08f-d9a1-4677-8b2e-0aeacfbbb531 is going to be deleted. [ 1522.997308] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.997557] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.027473] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.027688] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.043914] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.044106] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef90e1f-f512-4c74-82f2-c918b64f5aee is going to be deleted. [ 1523.045040] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.045263] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.071496] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.071709] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.112596] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.113075] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7173c74-e718-4fb3-b848-53964fb8e953 is going to be deleted. [ 1523.113715] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.113941] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.160278] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.172559] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.172735] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45e4fdd1-656b-4cc6-ba66-7fc4257c0446 is going to be deleted. [ 1523.173863] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.174100] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.175484] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.175608] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.176203] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.176297] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.208828] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.209037] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad is going to be deleted. [ 1523.209990] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.210302] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.245507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.245696] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e28ea-bf82-481a-ade4-549ebae6fbc3 is going to be deleted. [ 1523.247275] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.247612] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.269458] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.269651] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.312026] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.312221] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2987c0-489b-45df-9694-cf09b0682b7c is going to be deleted. [ 1523.313154] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.313367] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.315022] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.315162] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.339191] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.339406] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.374470] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.374658] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3469e958-4a31-4f2a-987e-042bbed3a4ae is going to be deleted. [ 1523.375579] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.375800] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.375891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.376029] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f70850f2-6628-4be4-939e-95e5fadec74b" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.376217] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.376389] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.376475] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.376607] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff847f4a-e188-46a1-bbea-b7ce5960a51a" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.377188] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.377377] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.377468] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.377587] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cadcc6df-baac-43fd-bf48-5485c0b69d95" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.377721] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.377871] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.377951] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.378134] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-101d7123-33df-4206-98ea-c31321fdee80" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.378364] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.378576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.378659] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.378776] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ef686cd-78eb-46c8-a0b8-b56b7873d69d" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.379585] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.379701] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.379742] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.379895] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.379976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.380141] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e28ea-bf82-481a-ade4-549ebae6fbc3" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.380266] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.380414] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.380491] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.380602] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de65717-98c6-48f1-a46a-5ef99f79f590" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.380714] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.380859] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.380933] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.381081] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aeddd4f-ae6e-483d-9a20-af39e6e3b5ff" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.381260] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.381409] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.381507] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.381632] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb5d077-5aae-475f-9ce6-a007397ccf52" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.381755] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.381900] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.381976] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.382101] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef90e1f-f512-4c74-82f2-c918b64f5aee" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.382241] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.382384] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.382459] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.382567] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bceb08f-d9a1-4677-8b2e-0aeacfbbb531" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.382679] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.382817] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.382891] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.383013] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7173c74-e718-4fb3-b848-53964fb8e953" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.383155] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.383298] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.383374] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.383476] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45e4fdd1-656b-4cc6-ba66-7fc4257c0446" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.383589] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.383724] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.383798] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.383901] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc1c5fc0-cee8-41b6-b731-3dd5ffb6f8ad" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.458877] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.459117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.459117] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.459320] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.459411] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.459539] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2987c0-489b-45df-9694-cf09b0682b7c" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.534534] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.534726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.534726] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.534940] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.534996] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.535123] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3469e958-4a31-4f2a-987e-042bbed3a4ae" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.663028] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eed4a972-98a5-4a44-9e59-8823c9af364e: rpc.has_security_group_logging(os_id): False [ 1523.681628] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.681893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.681893] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.682072] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.701866] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.702204] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.702332] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.702391] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.702578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.702658] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.702745] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e is going to be updated. [ 1523.762995] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.763279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.763279] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.763446] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.763578] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.776787] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: IN_PROGRESS for 2s [ 1525.798193] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: SUCCESS [ 1525.798592] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.111810] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.112182] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.112495] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.112863] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.113067] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.113496] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.115134] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.115499] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.117220] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.117643] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.117870] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.118431] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.983368] env[65353]: INFO networking_nsxv3.common.synchronization [req-d40c18db-bb46-4134-ad92-bd0fcf661f15 req-297b0f85-d2f4-4f7d-aef7-436b7c9f342a tempest-AttachVolumeNegativeTest-397759405 tempest-AttachVolumeNegativeTest-397759405-project-member] Enqueued Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1552.983368] env[65353]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed4a972-98a5-4a44-9e59-8823c9af364e with Priority: HIGHEST for action security_group_members [ 1552.983368] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed4a972-98a5-4a44-9e59-8823c9af364e taken with stack trace [, , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.983368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.983368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.983368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.983368] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.983368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.983368] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.984744] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.985032] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.985376] env[65353]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed4a972-98a5-4a44-9e59-8823c9af364e',) {} {{(pid=65353) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.488990] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.489461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.489461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.489461] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.489656] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.489806] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.489920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.489920] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.490056] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.490136] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.490223] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e is going to be updated. [ 1553.518353] env[65353]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65353) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.518576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.518576] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.518768] env[65353]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.518910] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.529310] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: IN_PROGRESS for 2s [ 1555.541618] env[65353]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed4a972-98a5-4a44-9e59-8823c9af364e in Status: SUCCESS [ 1555.542027] env[65353]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed4a972-98a5-4a44-9e59-8823c9af364e deletion is rescheduled due to dependency. [ 1555.542027] env[65353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed4a972-98a5-4a44-9e59-8823c9af364e" {{(pid=65353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.982607] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.983156] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.983653] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.984081] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.985782] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.985782] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.986983] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.987427] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.988462] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.988751] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.989239] env[65353]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.989672] env[65353]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0